00000001:02000400:3.0F:1789635091.831648:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789635104.338530:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1789635105.707645:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1043 MB/s 00000001:01000000:3.0:1789635105.957490:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1611 MB/s 00000001:01000000:2.0F:1789635106.207447:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8611 MB/s 00000020:02000000:3.0:1789635106.681114:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga8a99f2 00000400:02000000:1.0:1789635107.220687:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.130@tcp [8/256/0/180] 00008000:02000000:2.0:1789635110.072145:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789635140.983595:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789635147.714950:0:5823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789635147.714956:0:5823:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789635147.715115:0:5823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000db39b9e6 00000080:02000400:0.0:1789635147.715129:0:5823:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789635147.718752:0:5823:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789635147.718772:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789635147.718846:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000083a67bbb) 00000020:00000080:0.0:1789635147.718870:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789635147.734865:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789635147.735130:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789635147.751086:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789635147.751132:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789635147.751156:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789635147.751213:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789635147.751242:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789635147.751706:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789635147.751715:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789635147.751726:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb29ec 00000020:01000004:0.0:1789635147.751734:0:5823:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789635147.751739:0:5823:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789635147.751744:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000db39b9e6 from MGS 00000020:01000004:0.0:1789635147.751748:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789635147.751757:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000dfeaaa2a) 00000020:00000080:0.0:1789635147.751768:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789635147.751863:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000db39b9e6 from MGS, refs=2 00080000:01000000:0.0:1789635147.751869:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789635147.751874:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb29fa 00000100:00100000:0.0:1789635147.751976:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789635147.752116:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789635147.752122:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789635147.752981:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789635147.752995:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789635147.753875:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635147.754065:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789635147.754070:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789635147.754709:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789635147.754716:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789635147.755086:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789635147.755091:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789635147.755798:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635147.755802:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635147.755804:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635147.756078:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635147.756080:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635147.756082:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635147.756910:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789635147.762749:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789635148.006453:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3903 MB/s 00000001:01000000:3.0:1789635148.256438:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5315 MB/s 00000001:01000000:3.0:1789635148.507053:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 763 MB/s 00000001:01000000:2.0:1789635148.756672:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1059 MB/s 00080000:10000000:2.0:1789635148.762308:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789635148.779965:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789635148.780051:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789635148.780054:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789635148.784186:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789635148.785881:0:5823:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789635148.785938:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789635148.786629:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789635148.786657:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789635148.787616:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635148.790522:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789635148.790539:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789635148.793515:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789635148.793534:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789635148.795893:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789635148.795908:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789635148.796614:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789635148.796638:0:5823:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.130@tcp' 00000020:01000004:2.0:1789635148.796640:0:5823:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789635148.796695:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.130@tcp (typ=mgc) 00000020:00000080:2.0:1789635148.796718:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.130@tcp (00000000eb94305c) 00000020:00000080:2.0:1789635148.796746:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789635148.796858:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dd268d60@MGC192.168.201.130@tcp: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789635148.797148:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.130@tcp-0 is initialized 00000040:01000000:2.0:1789635148.797154:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789635148.797303:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789635148.799628:0:5839:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789635148.799683:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.130@tcp (uuid ec8828bc-aabc-4548-96aa-655e15bcddbb) 00000020:00000080:2.0:1789635148.799707:0:5823:0:(genops.c:1384:class_connect()) connect: client ec8828bc-aabc-4548-96aa-655e15bcddbb, cookie 0x77332204cfbb2a08 00000100:00080000:2.0:1789635148.799721:0:5823:0:(import.c:545:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789635148.799870:0:5823:0:(import.c:666:import_select_connection()) MGC192.168.201.130@tcp: import 00000000dd268d60 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635148.799918:0:5823:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002d0ba56d x1876568421957760/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635148.799946:0:5823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS 00000020:01000004:2.0:1789635148.799968:0:5823:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789635148.800061:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789635148.800074:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006fd19918) 00000020:00000080:2.0:1789635148.800087:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789635148.810368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ba56d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec8828bc-aabc-4548-96aa-655e15bcddbb:3305:1876568421957760:0@lo:250: 00000100:00100000:0.0:1789635148.811282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635148.814057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421957760 00000100:00100000:3.0:1789635148.814075:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421957760 00000100:00100000:3.0:1789635148.814128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635148.814135:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b756722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876568421957760:12345-0@lo:250: 00010000:00080000:3.0:1789635148.814164:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ec8828bc-aabc-4548-96aa-655e15bcddbb@0@lo t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:3.0:1789635148.814194:0:5835:0:(genops.c:1384:class_connect()) connect: client ec8828bc-aabc-4548-96aa-655e15bcddbb, cookie 0x77332204cfbb2a16 00000100:00080000:3.0:1789635148.815213:0:5835:0:(import.c:65:import_set_state_nolock()) 000000003e119aa7 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635148.815906:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b756722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:3305:x1876568421957760:12345-0@lo:250: Request processed in 1767us (4624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635148.815921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635148.818098:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789635148.818122:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1789635148.818132:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789635148.818139:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789635148.818142:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000dd268d60 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789635148.818147:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789635148.818170:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789635148.818178:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ba56d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec8828bc-aabc-4548-96aa-655e15bcddbb:3305:1876568421957760:0@lo:250: 00010000:00010000:2.0:1789635148.822832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635148.851549:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635148.851841:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789635148.851848:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789635148.853510:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789635148.853534:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789635148.854140:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789635148.854150:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789635148.855110:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635148.855517:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789635148.855525:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789635148.856209:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789635148.856216:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789635148.938125:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635148.938490:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789635148.938497:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789635148.940152:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789635148.940167:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789635148.941431:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635148.941662:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789635148.941668:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789635148.942483:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789635148.942491:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789635148.943183:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635148.943945:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789635148.943952:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789635148.945440:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789635148.945449:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789635148.946192:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635148.946606:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789635148.946613:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789635148.947605:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789635148.947638:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789635148.982783:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635148.983094:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789635148.983101:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789635148.985291:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635148.985307:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789635148.987619:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789635148.987632:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789635148.989053:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789635148.989080:0:5823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789635148.989086:0:5823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789635148.989220:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789635148.989451:0:5823:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789635148.989456:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789635148.989458:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789635148.989459:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635148.989460:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635148.989461:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635148.989463:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635148.989464:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635148.989465:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789635148.989467:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635148.989468:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635148.989469:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635148.989471:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635148.989473:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789635148.989475:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635148.989476:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789635148.989482:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635148.989483:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635148.989483:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635148.989484:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635148.989485:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635148.989486:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789635148.989486:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635148.989487:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635148.989488:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635148.989489:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635148.989535:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789635148.989555:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a083415c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421957888:0@lo:253: 00000100:00100000:3.0:1789635148.989638:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635148.989741:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000446fcaaa going to sleep for 11 seconds 00000100:00100000:2.0:1789635148.989838:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421957888 00000100:00100000:2.0:1789635148.989847:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421957888 00000100:00100000:2.0:1789635148.989923:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635148.989931:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000725418ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:5823:x1876568421957888:12345-0@lo:253: 20000000:01000000:2.0:1789635148.989990:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789635148.989994:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789635148.990572:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789635148.990640:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789635148.990972:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635148.992063:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789635148.992396:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789635148.992401:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789635148.992407:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789635148.992410:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789635148.992423:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789635148.992609:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635148.992859:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789635148.992871:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789635148.992914:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789635148.992954:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789635148.993049:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789635148.993127:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789635148.993135:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789635148.993172:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789635148.993179:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789635148.993203:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789635148.993216:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789635148.993485:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789635148.993534:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789635148.993562:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789635148.993567:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789635148.993577:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635148.993756:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789635148.993779:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789635148.993812:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789635148.993853:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789635148.993892:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789635148.993902:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789635148.993960:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789635148.993967:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789635148.994223:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789635148.994467:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789635148.994498:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789635148.994507:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789635148.994580:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789635148.994588:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789635148.994614:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789635148.994641:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789635148.994791:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789635148.994837:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789635148.994845:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789635148.995523:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789635148.995860:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789635148.995885:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.130@tcp for mdt 20000000:01000000:2.0:1789635148.995887:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789635148.995916:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789635148.995923:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789635148.995948:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789635148.995955:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:2.0:1789635148.996080:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789635148.996091:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789635148.996126:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789635148.996158:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789635148.996213:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789635148.996216:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789635148.996223:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789635148.996292:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789635148.996871:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789635148.997067:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789635149.003812:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789635149.003906:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789635149.004067:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789635149.004089:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789635149.004092:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789635149.004096:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789635149.004111:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789635149.004114:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789635149.004146:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789635149.004148:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789635149.005731:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789635149.006206:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789635149.006487:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789635149.006527:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789635149.006544:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789635149.006547:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789635149.007056:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1789635149.007472:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1789635149.007510:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1789635149.007593:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1789635149.007610:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789635149.007612:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789635149.007619:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789635149.007640:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007657:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007667:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007675:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007687:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007694:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007701:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6ec4b3c already unused, calling callback (0000000049b550c8) 00010000:00010000:2.0:1789635149.007704:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007711:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007724:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007730:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.007736:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a1d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789635149.007754:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789635149.199644:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000725418ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:5823:x1876568421957888:12345-0@lo:253: Request processed in 209702us (209994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635149.199667:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635149.199674:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a083415c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421957888:0@lo:253: 10000000:01000000:3.0:1789635149.199693:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789635149.199696:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635149.199698:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789635149.199700:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635149.199701:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789635149.199703:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635149.199704:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635149.199705:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789635149.199707:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789635149.199708:0:5823:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789635149.199710:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635149.199711:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635149.199732:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000db39b9e6 from lustre-MDT0000 10000000:01000000:3.0:1789635149.199766:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789635149.199769:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789635149.199773:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e79c61999c0 10000000:01000000:3.0:1789635149.199777:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789635149.199786:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e79c61999c0 from 1 10000000:01000000:3.0:1789635149.199790:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789635149.199829:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000004f06faa4/0x77332204cfbb2a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.199862:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000004f06faa4/0x77332204cfbb2a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.199873:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000004f06faa4/0x77332204cfbb2a24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635149.199893:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a083415c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958016:0@lo:101: 00000100:00100000:3.0:1789635149.199929:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635149.200034:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044df9435 going to sleep for 11 seconds 00000100:00100000:2.0:1789635149.200111:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958016 00000100:00100000:2.0:1789635149.200119:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958016 00000100:00100000:2.0:1789635149.200193:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635149.200201:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000240aa747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:5823:x1876568421958016:12345-0@lo:101: 00010000:00010000:2.0:1789635149.200214:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635149.200227:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2a24 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.200257:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.200268:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6ec4b3c/0x77332204cfbb2a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.200276:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6ec4b3c, rc 0) 00000100:00100000:2.0:1789635149.200364:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000240aa747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:5823:x1876568421958016:12345-0@lo:101: Request processed in 164us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635149.200371:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789635149.200450:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a083415c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958016:0@lo:101: 00010000:00010000:0.0:1789635149.200462:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000004f06faa4/0x77332204cfbb2a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.200470:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000004f06faa4/0x77332204cfbb2a24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635149.200524:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958144:0@lo:501: 00000100:00100000:0.0:1789635149.200549:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.200725:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002437befd going to sleep for 11 seconds 00000100:00100000:3.0:1789635149.201032:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958144 00000100:00100000:3.0:1789635149.201037:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958144 00000100:00100000:3.0:1789635149.201061:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635149.201068:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4deaf45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:5823:x1876568421958144:12345-0@lo:501: 00000100:00100000:3.0:1789635149.201342:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4deaf45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:5823:x1876568421958144:12345-0@lo:501: Request processed in 274us (791us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789635149.201350:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635149.201443:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958144:0@lo:501: 10000000:01000000:0.0:1789635149.201472:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789635149.201491:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000004f06faa4/0x77332204cfbb2a24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.201500:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000004f06faa4/0x77332204cfbb2a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635149.201516:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e79c8241800 10000000:01000000:0.0:1789635149.201520:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789635149.201525:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e79c8241800 10000000:01000000:0.0:1789635149.201528:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789635149.201531:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e79c8241800 from 1 10000000:01000000:0.0:1789635149.201533:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789635149.201555:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 0000000078138e61/0x77332204cfbb2a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.201572:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 0000000078138e61/0x77332204cfbb2a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.201587:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 0000000078138e61/0x77332204cfbb2a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635149.201600:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958272:0@lo:101: 00000100:00100000:0.0:1789635149.201630:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.201651:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002437befd going to sleep for 11 seconds 00000100:00100000:3.0:1789635149.201778:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958272 00000100:00100000:3.0:1789635149.201793:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958272 00000100:00100000:3.0:1789635149.201814:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789635149.201820:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052d972d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:5823:x1876568421958272:12345-0@lo:101: 00010000:00010000:3.0:1789635149.201827:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635149.201838:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c0c8380/0x77332204cfbb2a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2a32 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.201855:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c0c8380/0x77332204cfbb2a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2a32 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.201864:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c0c8380/0x77332204cfbb2a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2a32 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.201877:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c0c8380, rc 0) 00000100:00100000:3.0:1789635149.201912:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052d972d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+7:5823:x1876568421958272:12345-0@lo:101: Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635149.201918:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635149.202016:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958272:0@lo:101: 00010000:00010000:0.0:1789635149.202027:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 0000000078138e61/0x77332204cfbb2a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.202034:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 0000000078138e61/0x77332204cfbb2a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635149.202046:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789635149.202059:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 0000000078138e61/0x77332204cfbb2a32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.202076:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 0000000078138e61/0x77332204cfbb2a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635149.202083:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789635149.202086:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635149.202091:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e79c8241800 10000000:01000000:0.0:1789635149.202094:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789635149.202096:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789635149.202098:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789635149.202111:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000d80f3f11/0x77332204cfbb2a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.202118:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000d80f3f11/0x77332204cfbb2a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.202124:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000d80f3f11/0x77332204cfbb2a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635149.202135:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958400:0@lo:101: 00000100:00100000:0.0:1789635149.202160:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.202170:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002437befd going to sleep for 11 seconds 00000100:00100000:3.0:1789635149.202391:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958400 00000100:00100000:3.0:1789635149.202396:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958400 00000100:00100000:3.0:1789635149.202414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635149.202420:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b40be627 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+7:5823:x1876568421958400:12345-0@lo:101: 00010000:00010000:3.0:1789635149.202428:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635149.202435:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000be53316/0x77332204cfbb2a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2a40 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.202448:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000be53316/0x77332204cfbb2a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.202455:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000be53316/0x77332204cfbb2a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.202461:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000be53316, rc 0) 00000100:00100000:3.0:1789635149.202494:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b40be627 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+8:5823:x1876568421958400:12345-0@lo:101: Request processed in 74us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635149.202500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635149.202575:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958400:0@lo:101: 00010000:00010000:0.0:1789635149.202592:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000d80f3f11/0x77332204cfbb2a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.202598:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000d80f3f11/0x77332204cfbb2a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635149.202649:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958528:0@lo:501: 00000100:00100000:0.0:1789635149.202671:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.202696:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002437befd going to sleep for 11 seconds 00000100:00100000:3.0:1789635149.202801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958528 00000100:00100000:3.0:1789635149.202805:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958528 00000100:00100000:3.0:1789635149.202822:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635149.202827:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e228506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+8:5823:x1876568421958528:12345-0@lo:501: 00000100:00100000:3.0:1789635149.203032:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e228506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5823:x1876568421958528:12345-0@lo:501: Request processed in 205us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635149.203043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635149.203154:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958528:0@lo:501: 00000100:00100000:0.0:1789635149.203182:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958656:0@lo:503: 00000100:00100000:0.0:1789635149.203220:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.203241:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002437befd going to sleep for 11 seconds 00000100:00100000:3.0:1789635149.203476:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958656 00000100:00100000:3.0:1789635149.203482:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958656 00000100:00100000:3.0:1789635149.203501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635149.203506:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d0ffa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5823:x1876568421958656:12345-0@lo:503: 00000100:00100000:3.0:1789635149.203672:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d0ffa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5823:x1876568421958656:12345-0@lo:503: Request processed in 166us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635149.203680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635149.203817:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421958656:0@lo:503: 00000100:00100000:3.0:1789635149.204240:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5866:1876568421958784:0@lo:502: 00000100:00100000:3.0:1789635149.204293:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635149.204344:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f236e46 going to sleep for 11 seconds 00000100:00100000:0.0:1789635149.204449:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958784 00000100:00100000:0.0:1789635149.204453:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958784 00000100:00100000:0.0:1789635149.204473:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635149.204478:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f0f5f16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5866:x1876568421958784:12345-0@lo:502: 00000100:00100000:0.0:1789635149.204661:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f0f5f16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5866:x1876568421958784:12345-0@lo:502: Request processed in 183us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635149.204668:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635149.204841:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5866:1876568421958784:0@lo:502: 00000020:01000000:3.0:1789635149.204867:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635149.204879:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635149.204882:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789635149.204888:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789635149.204891:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789635149.204913:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007d732488) 00000020:00000080:3.0:1789635149.204934:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789635149.204942:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789635149.205047:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789635149.205054:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb2a55 00000020:00000080:3.0:1789635149.205305:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789635149.205346:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635149.205350:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635149.205351:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789635149.205354:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635149.205357:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635149.205363:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789635149.205367:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789635149.205374:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001b5814ee) 00000020:00000080:3.0:1789635149.205383:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789635149.205387:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789635149.205388:0:5866:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789635149.205391:0:5866:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789635149.205397:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789635149.205440:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000db39b9e6 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789635149.205450:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000dbc3476b) 00000020:00000080:3.0:1789635149.205458:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789635149.205522:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789635149.205528:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb2a6a 00000020:00000080:3.0:1789635149.205834:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789635149.205841:0:5866:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789635149.205846:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x77332204cfbb2a71 00080000:01000000:3.0:1789635149.205851:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789635149.205855:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb2a78 00080000:10000000:3.0:1789635149.206489:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789635149.206859:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789635149.213970:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789635149.267447:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789635149.267855:0:5866:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789635149.269895:0:5866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789635149.270138:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789635149.291540:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ad91e5ba) 00000020:00000080:2.0:1789635149.291586:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789635149.291661:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789635149.291668:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb2a86 00000020:00000080:2.0:1789635149.292267:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789635149.293568:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789635149.320251:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789635149.345070:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635149.374411:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635149.401527:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635149.422410:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789635149.440120:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x77332204cfbb2a8d 00000020:00000080:1.0:1789635149.440473:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789635149.440485:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635149.440492:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635149.440494:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789635149.440497:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635149.440504:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635149.440505:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789635149.440509:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789635149.440538:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789635149.440546:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635149.440548:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635149.440549:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789635149.440550:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635149.440552:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635149.440552:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789635149.440554:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789635149.440555:0:5866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789635149.440613:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adf1711e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5866:1876568421958912:0@lo:502: 00000100:00100000:1.0:1789635149.440701:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.440764:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421958912 00000100:00100000:0.0:1789635149.440775:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421958912 00000100:00100000:1.0:1789635149.440807:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051b8ef18 going to sleep for 11 seconds 00000100:00100000:0.0:1789635149.440816:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635149.440824:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9b0a8cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5866:x1876568421958912:12345-0@lo:502: 00000100:00100000:0.0:1789635149.441071:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9b0a8cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5866:x1876568421958912:12345-0@lo:502: Request processed in 248us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635149.441079:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635149.441104:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adf1711e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5866:1876568421958912:0@lo:502: 00000020:01000000:1.0:1789635149.441128:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635149.441132:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635149.441134:0:5866:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789635149.441138:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789635149.441206:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789635149.441228:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789635149.441256:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000d80f3f11/0x77332204cfbb2a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.441270:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000d80f3f11/0x77332204cfbb2a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635149.441278:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79c8241800 from 1 10000000:01000000:0.0:1789635149.441281:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789635149.441308:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.441336:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.441345:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635149.441356:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959040:0@lo:101: 00000100:00100000:0.0:1789635149.441381:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.441484:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099157237 going to sleep for 11 seconds 00000100:00100000:2.0:1789635149.441515:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959040 00000100:00100000:2.0:1789635149.441519:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959040 00000100:00100000:2.0:1789635149.441570:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789635149.441575:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000070ed2ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:5823:x1876568421959040:12345-0@lo:101: 00010000:00010000:2.0:1789635149.441588:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635149.441603:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2a94 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.441619:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.441625:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.441632:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004fc4fb1c, rc 0) 00000100:00100000:2.0:1789635149.441665:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000070ed2ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:5823:x1876568421959040:12345-0@lo:101: Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635149.441671:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635149.441695:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdaad90 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959040:0@lo:101: 00010000:00010000:3.0:1789635149.441707:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.441715:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635149.442160:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959168:0@lo:256: 00000100:00100000:3.0:1789635149.442189:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635149.442213:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf0edbb4 going to sleep for 11 seconds 00000100:00100000:2.0:1789635149.442234:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959168 00000100:00100000:2.0:1789635149.442239:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959168 00000100:00100000:2.0:1789635149.442300:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635149.442308:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c61522b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:5823:x1876568421959168:12345-0@lo:256: 20000000:01000000:2.0:1789635149.442351:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789635149.442357:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789635149.442428:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c61522b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:5823:x1876568421959168:12345-0@lo:256: Request processed in 121us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635149.442434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789635149.442487:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959168:0@lo:256: 10000000:01000000:3.0:1789635149.442967:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789635149.442982:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.442991:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635149.443000:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79c8241800 from 1 10000000:01000000:3.0:1789635149.443003:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635149.443023:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.443029:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.443034:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635149.443041:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959296:0@lo:101: 00000100:00100000:3.0:1789635149.443062:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635149.443085:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf0edbb4 going to sleep for 11 seconds 00000100:00100000:2.0:1789635149.443098:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959296 00000100:00100000:2.0:1789635149.443103:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959296 00000100:00100000:2.0:1789635149.443163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635149.443170:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009932bd58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:5823:x1876568421959296:12345-0@lo:101: 00010000:00010000:2.0:1789635149.443178:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635149.443189:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2aa2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.443216:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.443225:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.443232:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f4f220e, rc 0) 00000100:00100000:2.0:1789635149.443269:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009932bd58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5823:x1876568421959296:12345-0@lo:101: Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635149.443275:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635149.443289:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959296:0@lo:101: 00010000:00010000:3.0:1789635149.443298:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635149.443305:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635149.443383:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959424:0@lo:501: 00000100:00100000:3.0:1789635149.443407:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635149.443423:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf0edbb4 going to sleep for 11 seconds 00000100:00100000:1.0:1789635149.443441:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959424 00000100:00100000:1.0:1789635149.443446:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959424 00000100:00100000:1.0:1789635149.443473:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635149.443478:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022170663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5823:x1876568421959424:12345-0@lo:501: 00000100:00100000:1.0:1789635149.443971:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022170663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5823:x1876568421959424:12345-0@lo:501: Request processed in 493us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635149.443978:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789635149.443999:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959424:0@lo:501: 00000100:00100000:3.0:1789635149.444025:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959552:0@lo:503: 00000100:00100000:3.0:1789635149.444062:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635149.444082:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf0edbb4 going to sleep for 11 seconds 00000100:00100000:0.0:1789635149.444083:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959552 00000100:00100000:0.0:1789635149.444087:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959552 00000100:00100000:0.0:1789635149.444116:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635149.444122:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005fd34cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5823:x1876568421959552:12345-0@lo:503: 00000040:00080000:0.0:1789635149.444157:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635149.444195:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005fd34cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5823:x1876568421959552:12345-0@lo:503: Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635149.444201:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635149.444220:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959552:0@lo:503: 00000040:00080000:1.0:1789635149.444974:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789635149.445046:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789635149.445063:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635149.445118:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.445128:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635149.445174:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789635149.445177:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e79c8241800 10000000:01000000:2.0:1789635149.445180:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e79c8241800 10000000:01000000:2.0:1789635149.445182:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635149.445187:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79c8241800 from 1 10000000:01000000:2.0:1789635149.445189:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789635149.445212:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 0000000077504a3b/0x77332204cfbb2ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.445216:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 0000000077504a3b/0x77332204cfbb2ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.445234:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 0000000077504a3b/0x77332204cfbb2ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635149.445244:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959680:0@lo:101: 00000100:00100000:2.0:1789635149.445279:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635149.445336:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000005857e38c going to sleep for 11 seconds 00000100:00100000:1.0:1789635149.445442:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959680 00000100:00100000:1.0:1789635149.445447:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959680 00000100:00100000:1.0:1789635149.445478:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635149.445485:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f86e7c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5823:x1876568421959680:12345-0@lo:101: 00010000:00010000:1.0:1789635149.445496:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635149.445509:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070648d44/0x77332204cfbb2ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2ab0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635149.445530:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070648d44/0x77332204cfbb2ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635149.445537:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070648d44/0x77332204cfbb2ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635149.445552:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070648d44, rc 0) 00000100:00100000:1.0:1789635149.445678:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f86e7c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5823:x1876568421959680:12345-0@lo:101: Request processed in 193us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635149.445682:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635149.445737:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959680:0@lo:101: 00010000:00010000:2.0:1789635149.445747:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 0000000077504a3b/0x77332204cfbb2ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.445767:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 0000000077504a3b/0x77332204cfbb2ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635149.445824:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959808:0@lo:501: 00000100:00100000:2.0:1789635149.445847:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635149.445898:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000005857e38c going to sleep for 11 seconds 00000100:00100000:1.0:1789635149.445932:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959808 00000100:00100000:1.0:1789635149.445937:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959808 00000100:00100000:1.0:1789635149.445967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789635149.445974:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004786074d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5823:x1876568421959808:12345-0@lo:501: 00000100:00100000:1.0:1789635149.446298:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004786074d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5823:x1876568421959808:12345-0@lo:501: Request processed in 324us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635149.446305:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635149.446433:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959808:0@lo:501: 00000100:00100000:2.0:1789635149.446458:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959936:0@lo:503: 00000100:00100000:2.0:1789635149.446495:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635149.446548:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000005857e38c going to sleep for 11 seconds 00000100:00100000:1.0:1789635149.446687:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421959936 00000100:00100000:1.0:1789635149.446692:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421959936 00000100:00100000:1.0:1789635149.446766:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635149.446773:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e558fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5823:x1876568421959936:12345-0@lo:503: 00000100:00100000:1.0:1789635149.447078:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e558fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5823:x1876568421959936:12345-0@lo:503: Request processed in 306us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635149.447085:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789635149.447154:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421959936:0@lo:503: 00000100:00100000:2.0:1789635149.447890:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5871:1876568421960064:0@lo:502: 00000100:00100000:2.0:1789635149.447936:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635149.448001:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d268fc1 going to sleep for 11 seconds 00000100:00100000:1.0:1789635149.448043:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960064 00000100:00100000:1.0:1789635149.448049:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960064 00000100:00100000:1.0:1789635149.448120:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635149.448128:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2be2012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5871:x1876568421960064:12345-0@lo:502: 00000100:00100000:1.0:1789635149.448448:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2be2012 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5871:x1876568421960064:12345-0@lo:502: Request processed in 321us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635149.448455:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789635149.448729:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087d5d743 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5871:1876568421960064:0@lo:502: 00000020:01000004:3.0:1789635149.448806:0:5871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789635149.448823:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008b84d8cb) 00000020:00000080:3.0:1789635149.448846:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789635149.448924:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000db39b9e6 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789635149.448929:0:5871:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000db39b9e6 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789635149.448932:0:5871:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000db39b9e6 4 00010000:00080000:3.0:1789635149.448961:0:5871:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000028fe150e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1789635149.451066:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789635149.451370:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789635149.451409:0:5871:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635149.451422:0:5871:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x77332204cfbb2ac5 00000100:00080000:3.0:1789635149.451432:0:5871:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635149.451442:0:5871:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000028fe150e using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635149.451481:0:5871:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000010d21690 x1876568421960192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635149.451504:0:5871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789635149.451783:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000102b20c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5871:1876568421960320:0@lo:502: 00000100:00100000:3.0:1789635149.451862:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635149.451903:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043be216a going to sleep for 11 seconds 00000100:00100000:3.0:1789635149.451925:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960320 00000100:00100000:3.0:1789635149.451931:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960320 00000100:00100000:3.0:1789635149.451969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635149.451976:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000430b1a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5871:x1876568421960320:12345-0@lo:502: 00000100:00100000:3.0:1789635149.452217:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000430b1a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5871:x1876568421960320:12345-0@lo:502: Request processed in 241us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635149.452225:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635149.452275:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000102b20c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:5871:1876568421960320:0@lo:502: 00000040:00080000:3.0:1789635149.452299:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1789635149.452721:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568421960192:0@lo:38: 00000100:00100000:0.0:1789635149.452778:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789635149.452825:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789635149.452845:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789635149.452856:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 0000000077504a3b/0x77332204cfbb2ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.452866:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 0000000077504a3b/0x77332204cfbb2ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789635149.452915:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789635149.452918:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789635149.452919:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635149.452920:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635149.452921:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635149.452922:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635149.452924:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635149.452925:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789635149.452926:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635149.452927:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635149.452929:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635149.452930:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635149.452934:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789635149.452936:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635149.452937:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789635149.452938:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635149.452939:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635149.452940:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635149.452941:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635149.452942:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635149.452943:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789635149.452944:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635149.452945:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635149.452946:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635149.452947:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635149.452962:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789635149.452969:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000551b862a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421960448:0@lo:253: 00000100:00100000:0.0:1789635149.453004:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.453018:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000413c61ee going to sleep for 11 seconds 00000100:00100000:2.0:1789635149.453106:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960192 00000100:00100000:2.0:1789635149.453117:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960192 00000100:00100000:2.0:1789635149.453144:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635149.453148:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059fa3fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876568421960192:12345-0@lo:38: 00000100:00100000:2.0:1789635149.453194:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059fa3fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876568421960192:12345-0@lo:38: Request processed in 44us (415us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789635149.453200:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635149.453436:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635149.453443:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000028fe150e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635149.453447:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789635149.453450:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010d21690 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568421960192:0@lo:38: 00000100:00100000:2.0:1789635149.453743:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960448 00000100:00100000:2.0:1789635149.453748:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960448 00000100:00100000:2.0:1789635149.453813:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635149.453820:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004094b4f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5823:x1876568421960448:12345-0@lo:253: 20000000:01000000:2.0:1789635149.453841:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789635149.453856:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789635149.500341:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789635149.500474:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789635149.502703:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789635149.502713:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789635149.502738:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.502770:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.502779:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.502823:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.502840:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 12 pid: 5837 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635149.502855:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000663b2b7f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876568421960576:0@lo:104: 00000100:00100000:0.0:1789635149.502922:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635149.502992:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd2f2577 going to sleep for 11 seconds 00000100:00100000:2.0:1789635149.503071:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960576 00000100:00100000:2.0:1789635149.503082:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960576 00000100:00100000:2.0:1789635149.503129:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635149.503137:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006466d631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5858:x1876568421960576:12345-0@lo:104: 00010000:00010000:2.0:1789635149.503149:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503213:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789635149.503219:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006466d631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5858:x1876568421960576:12345-0@lo:104: Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635149.503226:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789635149.503245:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635149.503251:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503259:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000076de1761 already unused, calling callback (00000000fa5bf3e8) 10000000:00010000:2.0:1789635149.503277:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503285:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635149.503291:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635149.503297:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635149.503342:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503348:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635149.503362:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503368:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 0000000076de1761/0x77332204cfbb2a94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a9b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503383:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635149.503385:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635149.503386:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635149.503441:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006004e4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421960704:0@lo:103: 00000100:00100000:2.0:1789635149.503476:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635149.503550:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960704 00000100:00100000:2.0:1789635149.503555:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960704 00000100:00100000:0.0:1789635149.503803:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000663b2b7f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876568421960576:0@lo:104: 00010000:00010000:0.0:1789635149.503823:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503895:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 13 pid: 5837 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635149.503927:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635149.503941:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf6a8310 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:3307:x1876568421960704:12345-0@lo:103: 00010000:00010000:2.0:1789635149.503952:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635149.503956:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 13 pid: 5837 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503965:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 13 pid: 5837 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503978:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004fc4fb1c/0x77332204cfbb2a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2a94 expref: 13 pid: 5837 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503989:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.503996:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789635149.504006:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001294273s 00010000:00010000:2.0:1789635149.504009:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.504015:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.504020:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.504024:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.504028:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000635f3801 already unused, calling callback (0000000049b550c8) 00010000:00010000:2.0:1789635149.504036:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.504042:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.504052:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635149.504060:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635149.504089:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf6a8310 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3307:x1876568421960704:12345-0@lo:103: Request processed in 150us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635149.504095:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635149.504119:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006004e4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421960704:0@lo:103: 00010000:00010000:0.0:1789635149.504218:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.504227:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635149.504233:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000635f3801/0x77332204cfbb2acc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635149.510712:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004094b4f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5823:x1876568421960448:12345-0@lo:253: Request processed in 56882us (57697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635149.510743:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000551b862a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:5823:1876568421960448:0@lo:253: 00000100:00100000:1.0:1789635149.510748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:01000000:0.0:1789635149.510785:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789635149.510788:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789635149.510790:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789635149.510791:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635149.510792:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635149.510793:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635149.510795:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635149.510796:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635149.510798:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789635149.510799:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635149.510801:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635149.510803:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635149.510804:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789635149.510820:0:5823:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789635149.516161:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789635149.516725:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789635149.517055:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789635149.517294:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789635149.517643:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789635149.517985:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789635149.518871:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635149.519068:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789635149.519264:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635149.519521:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789635149.519730:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635149.519924:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789635149.549924:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789635149.577995:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789635149.578017:0:5876:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789635149.578022:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789635149.578497:0:5877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789635149.582145:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789635149.582335:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789635149.583298:0:5823:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789635149.583325:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789635149.583529:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635149.585173:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789635149.586448:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789635149.586520:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789635149.594922:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789635149.597845:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1789635149.602984:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789635149.603172:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789635149.603366:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789635149.603504:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789635149.603646:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789635149.604074:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789635149.604243:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789635149.604437:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789635149.604595:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789635149.604727:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789635149.605287:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789635149.605468:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789635149.605611:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789635149.606032:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789635149.606250:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789635149.606464:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789635149.606979:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789635149.607141:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789635149.607369:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789635149.607768:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789635149.607929:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789635149.608086:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789635149.608250:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789635149.608441:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789635149.609139:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789635149.610839:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789635149.612416:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789635149.613393:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789635149.613545:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789635149.613684:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789635149.613910:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789635149.614035:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789635149.614224:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789635149.626447:0:5877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789635149.652399:0:5823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789635149.652434:0:5823:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc3140192f988 00100000:10000000:3.0:1789635149.652441:0:5823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789635149.655973:0:5823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789635149.655990:0:5823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789635149.656017:0:5823:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789635149.656053:0:5823:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789635149.682765:0:5877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789635149.682863:0:5877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789635149.682867:0:5877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789635149.844452:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635150.869685:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635151.891572:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635152.038139:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789635152.924420:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635153.943850:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635154.707473:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789635154.707486:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789635154.707489:0:8:0:(import.c:65:import_set_state_nolock()) 0000000028fe150e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635154.707507:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000028fe150e using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635154.707536:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b0e43887 x1876568421960960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635154.707620:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635154.707634:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006004e4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421960832:0@lo:400: 00000100:00100000:2.0:1789635154.707717:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635154.707849:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e43887 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568421960960:0@lo:38: 00000100:00100000:0.0:1789635154.707880:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635154.707953:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960960 00000100:00100000:2.0:1789635154.707962:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960960 00000100:00100000:2.0:1789635154.708001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635154.708007:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000551b862a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876568421960960:12345-0@lo:38: 00010000:00080000:2.0:1789635154.708033:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:2.0:1789635154.708069:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x77332204cfbb2ad3 00000004:00100000:2.0:1789635154.708120:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635154.708406:0:5844:0:(import.c:65:import_set_state_nolock()) 0000000072e9f45f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635154.708459:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000551b862a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876568421960960:12345-0@lo:38: Request processed in 451us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635154.708468:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789635154.708549:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0e43887 x1876568421960960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635154.708564:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789635154.708571:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789635154.708575:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789635154.708577:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000028fe150e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789635154.708582:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e43887 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568421960960:0@lo:38: 00000100:00100000:3.0:1789635154.709432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421960832 00000100:00100000:3.0:1789635154.709441:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421960832 00000100:00100000:3.0:1789635154.710259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789635154.710271:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e997ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:3309:x1876568421960832:12345-0@lo:400: 00000100:00100000:3.0:1789635154.710380:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e997ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:3309:x1876568421960832:12345-0@lo:400: Request processed in 112us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635154.710387:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789635154.710479:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006004e4cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421960832:0@lo:400: 00010000:00010000:3.0:1789635154.968864:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789635155.844765:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc03f2890 20000000:00000080:2.0:1789635155.844786:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e79fec5f800 uarg=0000000000000000 20000000:01000000:2.0:1789635155.844828:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789635155.844837:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789635155.844843:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789635155.845457:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789635155.845473:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789635155.849456:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635155.849779:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789635155.849843:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789635155.849908:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789635155.849928:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789635155.849949:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635155.849969:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635155.849977:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635155.850024:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635155.850041:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 10 pid: 5837 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635155.850057:0:6321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006004e4cb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1876568421961088:0@lo:104: 00000100:00100000:2.0:1789635155.850150:0:6321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635155.850219:0:6321:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3331ccd going to sleep for 11 seconds 00000100:00100000:3.0:1789635155.850417:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961088 00000100:00100000:3.0:1789635155.850426:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961088 00000100:00100000:3.0:1789635155.850486:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635155.850496:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b002499 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:6321:x1876568421961088:12345-0@lo:104: 00010000:00010000:3.0:1789635155.850511:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635155.850574:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635155.850580:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b002499 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:6321:x1876568421961088:12345-0@lo:104: Request processed in 86us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635155.850587:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635155.850736:0:6321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006004e4cb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1876568421961088:0@lo:104: 00010000:00010000:0.0:1789635155.850778:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635155.851226:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635155.851242:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635155.851250:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc92f82a already unused, calling callback (00000000fa5bf3e8) 10000000:00010000:3.0:1789635155.851253:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635155.851261:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635155.851267:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635155.851272:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635155.851334:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635155.851341:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635155.851359:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635155.851366:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 00000000cc92f82a/0x77332204cfbb2aa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2aa9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635155.851384:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635155.851386:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635155.851387:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635155.851395:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635155.851406:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000102b20c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421961216:0@lo:103: 00000100:00100000:3.0:1789635155.851448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635155.851482:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961216 00000100:00100000:0.0:1789635155.851489:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961216 00010000:00010000:0.0:1789635155.851510:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 11 pid: 5837 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635155.851540:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635155.851547:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031be2c29 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:3308:x1876568421961216:12345-0@lo:103: 00010000:00010000:0.0:1789635155.851557:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635155.851562:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 11 pid: 5837 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851581:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 11 pid: 5837 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851594:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000f4f220e/0x77332204cfbb2aa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2aa2 expref: 11 pid: 5837 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851607:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851614:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851628:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851634:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851650:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851656:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851661:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000961127e8 already unused, calling callback (0000000049b550c8) 00010000:00010000:0.0:1789635155.851665:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851676:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851698:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851707:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635155.851735:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031be2c29 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:3308:x1876568421961216:12345-0@lo:103: Request processed in 190us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635155.851742:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789635155.851865:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851874:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635155.851880:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000961127e8/0x77332204cfbb2ada lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635155.852387:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000102b20c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421961216:0@lo:103: 00010000:00010000:3.0:1789635155.989564:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789635156.563518:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789635156.563526:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79c8241800 from 3 10000000:01000000:2.0:1789635156.563532:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789635156.563590:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000961127e8/0x77332204cfbb2ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635156.563613:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000961127e8/0x77332204cfbb2ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635156.563636:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000961127e8/0x77332204cfbb2ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635156.563681:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961344:0@lo:101: 00000100:00100000:2.0:1789635156.563766:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635156.569919:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293bc4f9 going to sleep for 11 seconds 00000100:00100000:3.0:1789635156.571132:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961344 00000100:00100000:3.0:1789635156.571154:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961344 00000100:00100000:3.0:1789635156.571227:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789635156.571238:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d455b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:5839:x1876568421961344:12345-0@lo:101: 00010000:00010000:3.0:1789635156.571260:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635156.571286:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc92f82a/0x77332204cfbb2ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2ae1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635156.571335:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc92f82a/0x77332204cfbb2ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635156.571349:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc92f82a/0x77332204cfbb2ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635156.571359:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc92f82a, rc 0) 00000100:00100000:3.0:1789635156.571447:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d455b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5839:x1876568421961344:12345-0@lo:101: Request processed in 211us (7682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635156.571456:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635156.572665:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961344:0@lo:101: 00010000:00010000:2.0:1789635156.572692:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000961127e8/0x77332204cfbb2ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635156.572703:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000961127e8/0x77332204cfbb2ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635156.572787:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961472:0@lo:256: 00000100:00100000:2.0:1789635156.572841:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635156.572883:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293bc4f9 going to sleep for 11 seconds 00000100:00100000:3.0:1789635156.572889:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961472 00000100:00100000:3.0:1789635156.572898:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961472 00000100:00100000:3.0:1789635156.572947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789635156.572957:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008afb432d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5839:x1876568421961472:12345-0@lo:256: 20000000:01000000:3.0:1789635156.572986:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789635156.573005:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789635156.573008:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789635156.573105:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008afb432d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5839:x1876568421961472:12345-0@lo:256: Request processed in 150us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635156.573113:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789635156.577129:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961472:0@lo:256: 10000000:01000000:2.0:1789635156.577199:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789635156.577209:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000961127e8/0x77332204cfbb2ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635156.577220:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000961127e8/0x77332204cfbb2ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635156.577230:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789635156.577232:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79c8241800 from 1 10000000:01000000:2.0:1789635156.577235:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635156.577279:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000000f4f220e/0x77332204cfbb2aef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635156.577299:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000000f4f220e/0x77332204cfbb2aef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635156.577308:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000000f4f220e/0x77332204cfbb2aef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635156.577345:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961600:0@lo:101: 00000100:00100000:2.0:1789635156.577422:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635156.577468:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293bc4f9 going to sleep for 11 seconds 00000100:00100000:1.0:1789635156.577825:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961600 00000100:00100000:1.0:1789635156.577834:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961600 00000100:00100000:1.0:1789635156.577890:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789635156.577899:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006162fd9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:5839:x1876568421961600:12345-0@lo:101: 00010000:00010000:1.0:1789635156.577914:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635156.578051:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000033fb5d47/0x77332204cfbb2af6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2aef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635156.578081:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033fb5d47/0x77332204cfbb2af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2aef expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635156.578092:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000033fb5d47/0x77332204cfbb2af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2aef expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635156.578102:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000033fb5d47, rc 0) 00000100:00100000:1.0:1789635156.578165:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006162fd9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5839:x1876568421961600:12345-0@lo:101: Request processed in 266us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635156.578172:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635156.578255:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961600:0@lo:101: 00010000:00010000:2.0:1789635156.578269:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000000f4f220e/0x77332204cfbb2aef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635156.578277:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000000f4f220e/0x77332204cfbb2aef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635156.578429:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961728:0@lo:501: 00000100:00100000:2.0:1789635156.578457:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635156.578486:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293bc4f9 going to sleep for 11 seconds 00000100:00100000:3.0:1789635156.578700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961728 00000100:00100000:3.0:1789635156.578708:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961728 00000100:00100000:3.0:1789635156.578750:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635156.578758:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089046399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5839:x1876568421961728:12345-0@lo:501: 00000100:00100000:3.0:1789635156.579071:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089046399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5839:x1876568421961728:12345-0@lo:501: Request processed in 315us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635156.579079:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635156.579201:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961728:0@lo:501: 00000100:00100000:2.0:1789635156.579234:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961856:0@lo:503: 00000100:00100000:2.0:1789635156.579277:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635156.579304:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293bc4f9 going to sleep for 11 seconds 00000100:00100000:1.0:1789635156.579488:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961856 00000100:00100000:1.0:1789635156.579493:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961856 00000100:00100000:1.0:1789635156.579517:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789635156.579531:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000329a2eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5839:x1876568421961856:12345-0@lo:503: 00000100:00100000:1.0:1789635156.579666:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000329a2eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5839:x1876568421961856:12345-0@lo:503: Request processed in 137us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635156.579673:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635156.579783:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421961856:0@lo:503: 00000100:00100000:2.0:1789635156.580548:0:6346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:6346:1876568421961984:0@lo:502: 00000100:00100000:2.0:1789635156.580600:0:6346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635156.580635:0:6346:0:(client.c:2716:ptlrpc_set_wait()) set 000000001097cc5f going to sleep for 11 seconds 00000100:00100000:3.0:1789635156.580915:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421961984 00000100:00100000:3.0:1789635156.580922:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421961984 00000100:00100000:3.0:1789635156.580963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789635156.580971:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002610bff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6346:x1876568421961984:12345-0@lo:502: 00000100:00100000:3.0:1789635156.581148:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002610bff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6346:x1876568421961984:12345-0@lo:502: Request processed in 178us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635156.581155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635156.582233:0:6346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084aad541 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:6346:1876568421961984:0@lo:502: 00000020:01000000:2.0:1789635156.582272:0:6346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635156.582284:0:6346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635156.582287:0:6346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789635156.582294:0:6346:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79c8241800 00000020:00000080:2.0:1789635156.582297:0:6346:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789635156.582393:0:6346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:6346:1876568421962112:0@lo:502: 00000100:00100000:2.0:1789635156.582448:0:6346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635156.582487:0:6346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635156.582744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421962112 00000100:00100000:1.0:1789635156.582751:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421962112 00000100:00100000:1.0:1789635156.582789:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789635156.582798:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6346:x1876568421962112:12345-0@lo:502: 00000100:00100000:1.0:1789635156.582994:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6346:x1876568421962112:12345-0@lo:502: Request processed in 196us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635156.583002:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635156.583132:0:6346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:6346:1876568421962112:0@lo:502: 00000020:01000000:2.0:1789635156.583154:0:6346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635156.583160:0:6346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635156.583163:0:6346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789635156.583167:0:6346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789635156.583345:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789635156.583446:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789635156.583459:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635156.583471:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635157.012729:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635158.036548:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635159.060488:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635159.827542:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421962240:0@lo:400: 00000100:00100000:1.0:1789635159.827637:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635159.827727:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635159.827736:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421962368:0@lo:400: 00000100:00100000:1.0:1789635159.827778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635159.827805:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421962240 00000100:00100000:2.0:1789635159.827817:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421962240 00000100:00100000:1.0:1789635159.827832:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421962368 00000100:00100000:1.0:1789635159.827838:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421962368 00000100:00100000:2.0:1789635159.827866:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635159.827877:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3306:x1876568421962240:12345-0@lo:400: 00000100:00100000:1.0:1789635159.827884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635159.827895:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421962368:12345-0@lo:400: 00000100:00100000:1.0:1789635159.827949:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421962368:12345-0@lo:400: Request processed in 55us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635159.827952:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3306:x1876568421962240:12345-0@lo:400: Request processed in 77us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635159.827962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635159.827964:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789635159.828034:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e79dbcb3b80 x1876568421962368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635159.828051:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421962368:0@lo:400: 00000100:00100000:1.0:1789635159.828076:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421962240:0@lo:400: 00000020:01000004:2.0:1789635159.893141:0:6687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789635159.893144:0:6687:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789635159.893383:0:6687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e79fb977800 00000020:01000004:2.0:1789635159.893407:0:6687:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789635159.893421:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789635159.893438:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e79c6198000) 00000020:00000080:2.0:1789635159.893451:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789635159.901594:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789635159.901760:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789635159.913738:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789635159.917295:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789635159.917420:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789635159.917472:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789635159.917495:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789635159.917834:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789635159.917845:0:6687:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789635159.917860:0:6687:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x77332204cfbb2b04 00000020:01000004:1.0:1789635159.917868:0:6687:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789635159.917888:0:6687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789635159.917892:0:6687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789635159.917898:0:6687:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789635159.917902:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789635159.917921:0:6687:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e79fe918000) 00000020:00000080:1.0:1789635159.917932:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1789635159.920279:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635159.920504:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789635159.920511:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789635159.921924:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635159.921933:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789635159.922287:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789635159.922293:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789635159.923663:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635159.923851:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789635159.923863:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789635159.924456:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789635159.924461:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789635159.939831:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635159.940107:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789635159.940115:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789635159.941731:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635159.941742:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789635159.942209:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789635159.942215:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789635159.944687:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635159.944921:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789635159.944928:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789635159.945587:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789635159.945596:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789635159.973277:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635159.973650:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789635159.973658:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789635159.974635:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789635159.974646:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789635159.975112:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789635159.975139:0:6687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789635159.975146:0:6687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789635159.985664:0:6687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789635159.985707:0:6687:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789635159.985712:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789635159.985713:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635159.985715:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635159.985716:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635159.985717:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635159.985718:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635159.985720:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635159.985721:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635159.985723:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635159.985724:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635159.985730:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635159.985734:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789635159.985736:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635159.985737:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635159.985738:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635159.985739:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635159.985740:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635159.985741:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635159.985742:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635159.985743:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789635159.985744:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789635159.985745:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635159.985746:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635159.985775:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789635159.985796:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421962496:0@lo:253: 00000100:00100000:3.0:1789635159.985871:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635159.985941:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a096c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635159.986653:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421962496 00000100:00100000:1.0:1789635159.986664:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421962496 00000100:00100000:1.0:1789635159.986743:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635159.986753:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421962496:12345-0@lo:253: 20000000:01000000:1.0:1789635159.986792:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789635159.986796:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789635159.986802:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789635159.986805:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789635159.987616:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635159.987801:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789635159.987814:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789635159.987842:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789635159.987847:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789635159.987862:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789635159.987888:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789635159.988088:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789635159.988102:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:1.0:1789635159.988103:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789635159.988122:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789635159.988126:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789635159.988172:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789635159.988182:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:1.0:1789635159.988213:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789635159.988221:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789635159.988238:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789635159.988283:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789635159.988876:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789635159.988889:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:1.0:1789635159.988890:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789635159.988912:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789635159.988916:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789635159.988931:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789635159.988934:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:1.0:1789635159.988988:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789635159.988998:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789635159.989030:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789635159.989060:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789635159.989074:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789635159.989077:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789635159.989081:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789635159.989100:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789635159.989102:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789635159.989133:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789635159.989135:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789635159.989771:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789635159.990073:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789635159.990114:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789635159.990172:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789635159.990185:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789635159.990187:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789635159.990782:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789635159.990829:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789635159.990872:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789635159.991082:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789635159.991116:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789635159.991144:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789635159.991153:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789635159.991155:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789635159.991839:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1789635159.991894:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1789635159.991952:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789635159.992168:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789635159.992206:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789635159.992258:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789635159.992274:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789635159.992276:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789635159.992285:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789635159.992307:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992390:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992398:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992404:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85200/0x77332204cfbb2ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992411:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992453:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85200/0x77332204cfbb2ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992470:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79d3b85200/0x77332204cfbb2ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 12 pid: 5837 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635159.992493:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421962624:0@lo:104: 00000100:00100000:1.0:1789635159.992581:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635159.992644:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421962624 00010000:00010000:1.0:1789635159.992648:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992658:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 12 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635159.992665:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421962624 00000100:00100000:1.0:1789635159.992669:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421962752:0@lo:104: 00000100:00100000:1.0:1789635159.992694:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635159.992753:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.992762:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2a2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 12 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635159.992771:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421962880:0@lo:104: 00000100:00100000:1.0:1789635159.992791:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635159.992792:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421962752 00000100:00100000:2.0:1789635159.992798:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421962752 00000100:00100000:1.0:1789635159.992802:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635159.992819:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421962880 00000100:00100000:2.0:1789635159.992822:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421962880 00000100:00100000:2.0:1789635159.992839:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635159.992849:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:5836:x1876568421962624:12345-0@lo:104: 00010000:00010000:2.0:1789635159.992864:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.992941:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635159.992947:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421962624:0@lo:104: 00000100:00100000:2.0:1789635159.992953:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:5836:x1876568421962624:12345-0@lo:104: Request processed in 103us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635159.992962:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635159.992982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635159.992989:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:5836:x1876568421962752:12345-0@lo:104: 00010000:00010000:2.0:1789635159.992997:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993048:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789635159.993051:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421962752:0@lo:104: 00000100:00100000:2.0:1789635159.993058:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:5836:x1876568421962752:12345-0@lo:104: Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635159.993066:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635159.993081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635159.993087:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5836:x1876568421962880:12345-0@lo:104: 00010000:00010000:2.0:1789635159.993095:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993134:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789635159.993141:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5836:x1876568421962880:12345-0@lo:104: Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635159.993145:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421962880:0@lo:104: 00000100:00100000:2.0:1789635159.993152:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789635159.993171:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993339:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789635159.993345:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993351:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635159.993360:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993367:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635159.993372:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635159.993376:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635159.993400:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993404:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635159.993419:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993424:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2ab7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635159.993435:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421963008:0@lo:103: 00010000:00010000:3.0:1789635159.993436:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635159.993440:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993444:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030a00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635159.993446:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993457:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635159.993469:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635159.993472:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789635159.993484:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635159.993485:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993490:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635159.993495:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993499:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a47 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993509:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635159.993511:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993515:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635159.993516:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635159.993519:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789635159.993520:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635159.993526:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635159.993528:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421963136:0@lo:103: 10000000:01000000:3.0:1789635159.993533:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635159.993548:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993554:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789635159.993555:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635159.993582:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993587:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2a24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2a2b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635159.993600:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635159.993602:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635159.993604:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635159.993608:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963008 00000100:00100000:3.0:1789635159.993614:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421963264:0@lo:103: 00000100:00100000:1.0:1789635159.993615:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963008 00010000:00010000:1.0:1789635159.993639:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85200/0x77332204cfbb2ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 13 pid: 5837 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635159.993646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635159.993672:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963136 00000100:00100000:1.0:1789635159.993675:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963136 00010000:00010000:1.0:1789635159.993688:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 14 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635159.993694:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963264 00010000:00010000:0.0:1789635159.993697:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635159.993700:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963264 00000100:00100000:1.0:1789635159.993705:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635159.993714:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:3308:x1876568421963008:12345-0@lo:103: 00010000:00010000:3.0:1789635159.993721:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2a2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 15 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.993726:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635159.993735:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85200/0x77332204cfbb2ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 15 pid: 5837 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635159.993740:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789635159.993748:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85200/0x77332204cfbb2ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 15 pid: 5837 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635159.993749:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789635159.993765:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85200/0x77332204cfbb2ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2ab0 expref: 15 pid: 5837 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.993778:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635159.993809:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:3308:x1876568421963008:12345-0@lo:103: Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635159.993815:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635159.993833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635159.993839:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:3308:x1876568421963136:12345-0@lo:103: 00010000:00010000:1.0:1789635159.993856:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635159.993860:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 13 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.993870:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 13 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.993881:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2a40 expref: 13 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.993892:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635159.993901:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789635159.993911:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635159.993916:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3308:x1876568421963136:12345-0@lo:103: Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635159.993920:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3306:x1876568421963264:12345-0@lo:103: 00000100:00100000:1.0:1789635159.993925:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789635159.993938:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635159.993943:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2a2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 11 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993951:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 11 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993958:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2a2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2a24 expref: 11 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993968:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993974:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993983:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993987:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.993998:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.994003:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.994006:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635159.994008:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.994013:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.994023:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635159.994029:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635159.994036:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.994045:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635159.994053:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635159.994054:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:3306:x1876568421963264:12345-0@lo:103: Request processed in 136us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635159.994066:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:1.0:1789635159.994073:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789635159.994092:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421963264:0@lo:103: 00000100:00100000:3.0:1789635159.994283:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421963136:0@lo:103: 00000100:00100000:3.0:1789635159.994292:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421963008:0@lo:103: 00000100:00100000:2.0:1789635160.024421:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:6687:x1876568421962496:12345-0@lo:253: Request processed in 37657us (38538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.024437:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635160.024443:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421962496:0@lo:253: 10000000:01000000:3.0:1789635160.024458:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789635160.024462:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635160.024464:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635160.024465:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635160.024466:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789635160.024496:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635160.024497:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635160.024499:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635160.024501:0:6687:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789635160.024503:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635160.024504:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635160.024526:0:6687:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e79fb977800 from lustre-OST0000 10000000:01000000:3.0:1789635160.024576:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789635160.024580:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789635160.024587:0:6687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e79c61999c0 local copy 10000000:01000000:3.0:1789635160.024592:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789635160.024633:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.024647:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.024657:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.024676:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963392:0@lo:101: 00000100:00100000:3.0:1789635160.024711:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.024772:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.025307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963392 00000100:00100000:2.0:1789635160.025332:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963392 00000100:00100000:2.0:1789635160.025368:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789635160.025376:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+9:6687:x1876568421963392:12345-0@lo:101: 00010000:00010000:2.0:1789635160.025401:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635160.025415:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2b19 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.025439:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2b19 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.025449:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b19 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.025458:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175a00, rc 0) 00000100:00100000:2.0:1789635160.025498:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:6687:x1876568421963392:12345-0@lo:101: Request processed in 123us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.025504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789635160.025649:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963392:0@lo:101: 00010000:00010000:3.0:1789635160.025661:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.025670:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.025771:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963520:0@lo:501: 00000100:00100000:3.0:1789635160.025789:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.025817:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.025858:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963520 00000100:00100000:2.0:1789635160.025861:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963520 00000100:00100000:2.0:1789635160.025883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789635160.025894:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:6687:x1876568421963520:12345-0@lo:501: 00000100:00100000:2.0:1789635160.026060:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:6687:x1876568421963520:12345-0@lo:501: Request processed in 166us (268us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635160.026067:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635160.026086:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963520:0@lo:501: 10000000:01000000:3.0:1789635160.026098:0:6687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789635160.026121:0:6687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789635160.026126:0:6687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026134:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026141:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026166:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789635160.026184:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e79fb977800 10000000:01000000:3.0:1789635160.026188:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789635160.026192:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e79c61999c0 10000000:01000000:3.0:1789635160.026195:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789635160.026198:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e79c61999c0 from 1 10000000:01000000:3.0:1789635160.026200:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789635160.026216:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026224:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026232:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.026243:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963648:0@lo:101: 00000100:00100000:3.0:1789635160.026274:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.026295:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.026339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963648 00000100:00100000:2.0:1789635160.026344:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963648 00000100:00100000:2.0:1789635160.026366:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635160.026372:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+10:6687:x1876568421963648:12345-0@lo:101: 00010000:00010000:2.0:1789635160.026379:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635160.026388:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02175200/0x77332204cfbb2b2e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2b27 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.026411:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175200/0x77332204cfbb2b2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2b27 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.026419:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02175200/0x77332204cfbb2b2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b27 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.026426:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175200, rc 0) 00000100:00100000:2.0:1789635160.026453:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421963648:12345-0@lo:101: Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.026459:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789635160.026468:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963648:0@lo:101: 00010000:00010000:3.0:1789635160.026477:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b2e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026498:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2b2e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635160.026512:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789635160.026526:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b2e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026650:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b2e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635160.026657:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789635160.026660:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789635160.026664:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789635160.026665:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789635160.026666:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789635160.026671:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026678:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026684:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.026685:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635160.026689:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026692:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.026698:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.026702:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963776:0@lo:101: 10000000:00010000:0.0:1789635160.026714:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635160.026720:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789635160.026729:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635160.026739:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.026745:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789635160.026754:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789635160.026769:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.026777:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1676200/0x77332204cfbb2b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x77332204cfbb2b20 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.026783:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789635160.026790:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635160.026791:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635160.026793:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421963904:0@lo:103: 00010000:00010000:0.0:1789635160.026793:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635160.026820:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635160.026833:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963776 00000100:00100000:2.0:1789635160.026837:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963776 00000100:00100000:2.0:1789635160.026855:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635160.026862:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421963776:12345-0@lo:101: 00010000:00010000:2.0:1789635160.026868:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635160.026876:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2b35 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.026888:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.026896:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.026902:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02174600, rc 0) 00000100:00100000:2.0:1789635160.026928:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421963776:12345-0@lo:101: Request processed in 67us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.026934:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789635160.026946:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421963776:0@lo:101: 00010000:00010000:3.0:1789635160.026954:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.026962:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.027018:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964032:0@lo:501: 00000100:00100000:0.0:1789635160.027031:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421963904 00000100:00100000:0.0:1789635160.027035:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421963904 00000100:00100000:3.0:1789635160.027040:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.027061:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635160.027072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635160.027079:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3306:x1876568421963904:12345-0@lo:103: 00010000:00010000:0.0:1789635160.027088:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635160.027098:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2b19 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.027108:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635160.027135:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:3306:x1876568421963904:12345-0@lo:103: Request processed in 58us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635160.027142:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635160.027151:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421963904:0@lo:103: 00000100:00100000:2.0:1789635160.027195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964032 00000100:00100000:2.0:1789635160.027199:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964032 00000100:00100000:2.0:1789635160.027219:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789635160.027225:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964032:12345-0@lo:501: 00000100:00100000:2.0:1789635160.027402:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964032:12345-0@lo:501: Request processed in 177us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.027409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789635160.027432:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964032:0@lo:501: 00000100:00100000:3.0:1789635160.027458:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964160:0@lo:503: 00000100:00100000:3.0:1789635160.027647:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.027672:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.027765:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964160 00000100:00100000:2.0:1789635160.027769:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964160 00000100:00100000:2.0:1789635160.027789:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635160.027795:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964160:12345-0@lo:503: 00000100:00100000:2.0:1789635160.027932:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964160:12345-0@lo:503: Request processed in 136us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.027939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789635160.027948:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964160:0@lo:503: 00000040:00080000:3.0:1789635160.028228:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635160.028290:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964288:0@lo:502: 00000100:00100000:3.0:1789635160.028346:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.028373:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.028385:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964288 00000100:00100000:2.0:1789635160.028389:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964288 00000100:00100000:2.0:1789635160.028411:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789635160.028418:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964288:12345-0@lo:502: 00000100:00100000:2.0:1789635160.028541:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964288:12345-0@lo:502: Request processed in 123us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.028548:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789635160.028639:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964288:0@lo:502: 00000040:00080000:3.0:1789635160.028850:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789635160.028882:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789635160.028898:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789635160.028922:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789635160.028941:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789635160.028957:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789635160.028970:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964416:0@lo:502: 00000100:00100000:3.0:1789635160.028995:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.029011:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7a09b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.029035:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964416 00000100:00100000:2.0:1789635160.029039:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964416 00000100:00100000:2.0:1789635160.029063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635160.029069:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964416:12345-0@lo:502: 00000100:00100000:2.0:1789635160.029172:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964416:12345-0@lo:502: Request processed in 103us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.029187:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789635160.029188:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964416:0@lo:502: 00000040:00080000:3.0:1789635160.029250:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789635160.029258:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789635160.029757:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789635160.029769:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789635160.029775:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635160.029777:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789635160.029780:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789635160.029801:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e79e74419c0) 00000020:00000080:3.0:1789635160.029820:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789635160.029824:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789635160.029881:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79fb977800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789635160.029887:0:6708:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789635160.029894:0:6708:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x77332204cfbb2b4a 00010000:00010000:3.0:1789635160.033420:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789635160.033759:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789635160.035180:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789635160.035384:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789635160.039049:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789635160.039556:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789635160.041185:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789635160.041199:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635160.041207:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635160.041209:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789635160.041214:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635160.041218:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635160.041220:0:6708:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789635160.041223:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789635160.041225:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789635160.041279:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635160.041283:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635160.041285:0:6708:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789635160.041288:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789635160.041655:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789635160.041686:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789635160.041714:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.041728:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635160.041738:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fb977800 from 1 10000000:01000000:3.0:1789635160.041741:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635160.041782:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.041790:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.041803:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.041828:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964544:0@lo:101: 00000100:00100000:3.0:1789635160.041903:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.041949:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f91200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.042013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964544 00000100:00100000:2.0:1789635160.042021:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964544 00000100:00100000:2.0:1789635160.045710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789635160.045727:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+11:6687:x1876568421964544:12345-0@lo:101: 00010000:00010000:2.0:1789635160.045745:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635160.045762:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2b51 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.045787:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.045795:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.045801:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175400, rc 0) 00000100:00100000:2.0:1789635160.045868:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421964544:12345-0@lo:101: Request processed in 147us (3967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.045873:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789635160.046077:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964544:0@lo:101: 00010000:00010000:0.0:1789635160.046093:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.046100:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635160.046199:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964672:0@lo:501: 00000100:00100000:0.0:1789635160.046223:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635160.048752:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7b32480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.049350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964672 00000100:00100000:3.0:1789635160.049359:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964672 00000100:00100000:3.0:1789635160.049665:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789635160.049675:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421964672:12345-0@lo:501: 00000100:00100000:3.0:1789635160.050029:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421964672:12345-0@lo:501: Request processed in 354us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.050038:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789635160.050152:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964672:0@lo:501: 00000100:00100000:1.0:1789635160.050199:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964800:0@lo:503: 00000100:00100000:1.0:1789635160.050243:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635160.050280:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.050469:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964800 00000100:00100000:3.0:1789635160.050475:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964800 00000100:00100000:3.0:1789635160.050500:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789635160.050506:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421964800:12345-0@lo:503: 00000100:00100000:3.0:1789635160.050715:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421964800:12345-0@lo:503: Request processed in 209us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.050722:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789635160.050824:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964800:0@lo:503: 00000040:00080000:1.0:1789635160.051077:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635160.051141:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964928:0@lo:502: 00000100:00100000:1.0:1789635160.051170:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635160.051268:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.051344:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421964928 00000100:00100000:3.0:1789635160.051348:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421964928 00000100:00100000:3.0:1789635160.051464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635160.051474:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421964928:12345-0@lo:502: 00000100:00100000:3.0:1789635160.051618:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421964928:12345-0@lo:502: Request processed in 145us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635160.051667:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421964928:0@lo:502: 00000040:00080000:1.0:1789635160.051877:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789635160.051919:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789635160.051937:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965056:0@lo:502: 00000100:00100000:1.0:1789635160.051968:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635160.051982:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.052038:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965056 00000100:00100000:2.0:1789635160.052043:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965056 00000100:00100000:3.0:1789635160.052127:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635160.052216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635160.052224:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421965056:12345-0@lo:502: 00000100:00100000:3.0:1789635160.052616:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421965056:12345-0@lo:502: Request processed in 393us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.052624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635160.052677:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965056:0@lo:502: 00000040:00080000:1.0:1789635160.052754:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789635160.052765:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789635160.053121:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635160.053131:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635160.053133:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789635160.053138:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79fb977800 00000020:00000080:1.0:1789635160.053141:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635160.053155:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635160.053157:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635160.053158:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789635160.053161:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789635160.053270:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789635160.053293:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635160.053308:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.053434:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635160.053487:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789635160.053490:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e79fb977800 10000000:01000000:2.0:1789635160.053493:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e79fb977800 10000000:01000000:2.0:1789635160.053496:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635160.053501:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79fb977800 from 1 10000000:01000000:2.0:1789635160.053504:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789635160.053531:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.053539:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635160.053548:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635160.053583:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965184:0@lo:101: 00000100:00100000:2.0:1789635160.053615:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635160.053831:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fdf4da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635160.053888:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965184 00000100:00100000:0.0:1789635160.053894:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965184 00000100:00100000:3.0:1789635160.054008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789635160.054016:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421965184:12345-0@lo:101: 00010000:00010000:3.0:1789635160.054025:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635160.054038:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2b5f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.054058:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.054069:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.054077:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676800, rc 0) 00000100:00100000:3.0:1789635160.054121:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965184:12345-0@lo:101: Request processed in 106us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.054128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789635160.054211:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965184:0@lo:101: 00010000:00010000:0.0:1789635160.054223:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.054232:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635160.054299:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965312:0@lo:501: 00000100:00100000:0.0:1789635160.054350:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635160.054364:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7b32b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.054504:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965312 00000100:00100000:3.0:1789635160.054509:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965312 00000100:00100000:3.0:1789635160.054534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789635160.054540:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965312:12345-0@lo:501: 00000100:00100000:3.0:1789635160.054734:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965312:12345-0@lo:501: Request processed in 194us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.054742:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789635160.054811:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965312:0@lo:501: 00000100:00100000:0.0:1789635160.054834:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965440:0@lo:503: 00000100:00100000:0.0:1789635160.054864:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635160.054888:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7b32b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.054926:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965440 00000100:00100000:3.0:1789635160.054930:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965440 00000100:00100000:3.0:1789635160.054976:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789635160.054982:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965440:12345-0@lo:503: 00000100:00100000:3.0:1789635160.055110:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965440:12345-0@lo:503: Request processed in 128us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.055116:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789635160.055172:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965440:0@lo:503: 00000040:00080000:0.0:1789635160.055442:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635160.055501:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965568:0@lo:502: 00000100:00100000:0.0:1789635160.055537:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635160.057150:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7b32b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635160.057487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965568 00000100:00100000:2.0:1789635160.057495:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965568 00000100:00100000:2.0:1789635160.057541:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635160.057550:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965568:12345-0@lo:502: 00000100:00100000:2.0:1789635160.057860:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965568:12345-0@lo:502: Request processed in 311us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.057868:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789635160.057936:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965568:0@lo:502: 00000040:00080000:0.0:1789635160.058192:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789635160.058237:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789635160.058262:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789635160.058300:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789635160.058481:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789635160.058533:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789635160.059064:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789635160.059113:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789635160.059172:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789635160.059209:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789635160.059245:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789635160.059355:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789635160.059389:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789635160.059417:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789635160.059457:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789635160.059489:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789635160.059519:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789635160.059659:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789635160.059699:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789635160.059733:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789635160.059780:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789635160.059818:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789635160.059849:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789635160.059898:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789635160.059936:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789635160.059969:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789635160.060016:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789635160.060053:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789635160.060101:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965696:0@lo:502: 00000100:00100000:1.0:1789635160.060173:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635160.060296:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.060401:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965696 00000100:00100000:3.0:1789635160.060409:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965696 00000100:00100000:3.0:1789635160.060493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789635160.060504:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965696:12345-0@lo:502: 00000100:00100000:3.0:1789635160.060748:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965696:12345-0@lo:502: Request processed in 245us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.060757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789635160.060770:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965696:0@lo:502: 00000040:00080000:2.0:1789635160.060825:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789635160.060834:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789635160.061292:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789635160.061334:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e79e76a3380) 00000020:00000080:2.0:1789635160.061354:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789635160.061559:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79fb977800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789635160.061576:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79fb977800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789635160.061579:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79fb977800 3 00010000:00080000:2.0:1789635160.061613:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79e4a6a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1789635160.063391:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789635160.063637:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789635160.063674:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635160.063691:0:6713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x77332204cfbb2b74 00000100:00080000:3.0:1789635160.063700:0:6713:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635160.063710:0:6713:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e79e4a6a000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635160.063744:0:6713:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fd5d5500 x1876568421965824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635160.063768:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789635160.063807:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876568421965824:0@lo:38: 00000100:00100000:0.0:1789635160.063875:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635160.063988:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965824 00000100:00100000:2.0:1789635160.063994:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965824 00000100:00100000:2.0:1789635160.064030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635160.064037:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876568421965824:12345-0@lo:38: 00010000:00080000:2.0:1789635160.064056:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:2.0:1789635160.064085:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x77332204cfbb2b7b 00000004:00100000:2.0:1789635160.064103:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635160.064130:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9e79e4a6d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635160.064184:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876568421965824:12345-0@lo:38: Request processed in 147us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.064192:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789635160.065651:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e79fd5d5500 x1876568421965824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635160.065665:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789635160.065674:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789635160.065683:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789635160.065688:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789635160.065691:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79e4a6a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789635160.065697:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876568421965824:0@lo:38: 00000040:00080000:3.0:1789635160.067673:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789635160.067917:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789635160.067952:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789635160.067977:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635160.067990:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789635160.068043:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789635160.068046:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789635160.068047:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635160.068048:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635160.068055:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635160.068057:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635160.068058:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789635160.068060:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635160.068061:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635160.068063:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635160.068064:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635160.068069:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789635160.068071:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789635160.068073:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789635160.068074:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635160.068075:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635160.068076:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635160.068077:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635160.068078:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789635160.068079:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635160.068080:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635160.068081:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635160.068082:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635160.068111:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789635160.068132:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965952:0@lo:253: 00000100:00100000:1.0:1789635160.068210:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635160.068292:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.068873:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421965952 00000100:00100000:3.0:1789635160.068882:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421965952 00000100:00100000:3.0:1789635160.068942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789635160.068953:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:6687:x1876568421965952:12345-0@lo:253: 20000000:01000000:3.0:1789635160.068983:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789635160.068997:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1789635160.083963:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1789635160.095606:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789635160.095629:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789635160.095660:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789635160.095673:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789635160.095707:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635160.095729:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635160.095740:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635160.095796:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635160.095831:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 13 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635160.095847:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876568421966080:0@lo:104: 00000100:00100000:1.0:1789635160.095929:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635160.095994:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966080 00000100:00100000:1.0:1789635160.096001:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635160.096006:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966080 00000100:00100000:3.0:1789635160.096076:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635160.096088:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5858:x1876568421966080:12345-0@lo:104: 00010000:00010000:3.0:1789635160.096106:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.096202:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635160.096211:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5858:x1876568421966080:12345-0@lo:104: Request processed in 125us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635160.096219:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789635160.096228:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635160.096236:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.096245:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175800 already unused, calling callback (ffffffffc1bf6c20) 00000100:00100000:1.0:1789635160.096250:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876568421966080:0@lo:104: 10000000:00010000:0.0:1789635160.096253:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.096269:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635160.096277:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635160.096279:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635160.096306:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635160.096408:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.096416:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635160.096450:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.096457:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02175800/0x77332204cfbb2ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2ae8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635160.096460:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421966208:0@lo:103: 00010000:00010000:0.0:1789635160.096478:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635160.096479:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635160.096482:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635160.096503:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635160.097007:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966208 00000100:00100000:0.0:1789635160.097014:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966208 00010000:00010000:0.0:1789635160.097039:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 14 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635160.097111:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635160.097118:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:3308:x1876568421966208:12345-0@lo:103: 00010000:00010000:0.0:1789635160.097127:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635160.097132:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2ae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 14 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097140:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 14 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097150:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2ae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2ae1 expref: 14 pid: 5836 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097162:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097175:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789635160.097189:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001518506s 00010000:00010000:0.0:1789635160.097193:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097197:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097201:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097205:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097208:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635160.097211:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097216:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097232:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635160.097241:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635160.097266:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635160.097275:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635160.097279:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:3308:x1876568421966208:12345-0@lo:103: Request processed in 162us (776us total) trans 0 rc 0/0 00010000:00010000:3.0:1789635160.097283:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2b82 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635160.097285:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635160.097835:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421966208:0@lo:103: 00000100:00100000:2.0:1789635160.113813:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:6687:x1876568421965952:12345-0@lo:253: Request processed in 44850us (45591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635160.113831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789635160.113894:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:6687:1876568421965952:0@lo:253: 10000000:01000000:1.0:1789635160.113913:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789635160.113917:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789635160.113919:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789635160.113921:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635160.113922:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635160.113923:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635160.113925:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635160.113927:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789635160.113928:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635160.113930:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635160.113932:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635160.113933:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789635160.113949:0:6687:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789635160.118773:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635160.118983:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789635160.119197:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635160.119646:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789635160.119863:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635160.120951:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789635160.122251:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789635160.279824:0:6687:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789635160.279831:0:6687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789635160.279880:0:6687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789635160.279950:0:6687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789635160.279971:0:6687:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789635160.280003:0:6687:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789635161.107401:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635162.131599:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635163.155486:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635164.179763:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635164.336501:0:7055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789635165.205343:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635165.460615:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635165.460644:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421966336:0@lo:400: 00000100:00100000:0.0:1789635165.460731:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.461035:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421966464:0@lo:400: 00000100:00100000:2.0:1789635165.461072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.461095:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635165.461101:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421966592:0@lo:400: 00000100:00100000:2.0:1789635165.461123:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.461150:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966464 00000100:00100000:2.0:1789635165.461159:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966464 00000100:00100000:2.0:1789635165.461198:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966592 00000100:00100000:2.0:1789635165.461202:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966592 00000100:00100000:2.0:1789635165.461228:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635165.461237:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421966464:12345-0@lo:400: 00000100:00100000:2.0:1789635165.461289:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421966464:12345-0@lo:400: Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.461296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635165.461333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635165.461340:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421966592:12345-0@lo:400: 00000100:00100000:2.0:1789635165.461385:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421966592:12345-0@lo:400: Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.461391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789635165.461445:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7b5c000 x1876568421966592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635165.461461:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421966592:0@lo:400: 00010000:00080000:2.0:1789635165.461482:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7b5c380 x1876568421966464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635165.461491:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421966464:0@lo:400: 00000100:00100000:2.0:1789635165.461529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966336 00000100:00100000:2.0:1789635165.461533:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966336 00000100:00100000:2.0:1789635165.461558:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789635165.461565:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3308:x1876568421966336:12345-0@lo:400: 00000100:00100000:2.0:1789635165.461599:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3308:x1876568421966336:12345-0@lo:400: Request processed in 34us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.461605:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789635165.461638:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421966336:0@lo:400: 00000100:00080000:2.0:1789635165.461661:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1789635165.462377:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789635165.462383:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79c8241800 from 21 10000000:01000000:1.0:1789635165.462388:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635165.462438:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635165.462449:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635165.462460:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635165.462488:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421966720:0@lo:101: 00000100:00100000:1.0:1789635165.462525:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635165.462592:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f24983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.463279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966720 00000100:00100000:2.0:1789635165.463288:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966720 00000100:00100000:2.0:1789635165.463355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789635165.463364:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5839:x1876568421966720:12345-0@lo:101: 00010000:00010000:2.0:1789635165.463377:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635165.463392:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2b89 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.463444:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.463455:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.463472:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175a00, rc 0) 00000100:00100000:2.0:1789635165.463519:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421966720:12345-0@lo:101: Request processed in 156us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.463525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789635165.463580:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421966720:0@lo:101: 00010000:00010000:2.0:1789635165.463596:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.463605:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635165.463660:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421966848:0@lo:501: 00000100:00100000:2.0:1789635165.463906:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.463937:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d86b9540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635165.464005:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966848 00000100:00100000:1.0:1789635165.464010:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966848 00000100:00100000:1.0:1789635165.464042:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635165.464049:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421966848:12345-0@lo:501: 00000100:00100000:1.0:1789635165.464276:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421966848:12345-0@lo:501: Request processed in 227us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635165.464284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789635165.464725:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421966848:0@lo:501: 00000100:00100000:2.0:1789635165.464756:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421966976:0@lo:503: 00000100:00100000:2.0:1789635165.464797:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.464824:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d86b9540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635165.464929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421966976 00000100:00100000:1.0:1789635165.464934:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421966976 00000100:00100000:1.0:1789635165.464968:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789635165.464985:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421966976:12345-0@lo:503: 00000100:00100000:1.0:1789635165.465128:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421966976:12345-0@lo:503: Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635165.465135:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789635165.465606:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421966976:0@lo:503: 00000100:00100000:1.0:1789635165.466294:0:7139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7139:1876568421967104:0@lo:502: 00000100:00100000:1.0:1789635165.466360:0:7139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635165.466394:0:7139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.466763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421967104 00000100:00100000:2.0:1789635165.466771:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421967104 00000100:00100000:2.0:1789635165.466809:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789635165.466818:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7139:x1876568421967104:12345-0@lo:502: 00000100:00100000:2.0:1789635165.468057:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7139:x1876568421967104:12345-0@lo:502: Request processed in 1236us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.468067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789635165.468567:0:7139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7139:1876568421967104:0@lo:502: 00000100:00100000:1.0:1789635165.468632:0:7139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7139:1876568421967232:0@lo:502: 00000100:00100000:1.0:1789635165.468674:0:7139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635165.470020:0:7139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbcce480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.473218:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421967232 00000100:00100000:2.0:1789635165.473236:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421967232 00000100:00100000:2.0:1789635165.473349:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789635165.473362:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7139:x1876568421967232:12345-0@lo:502: 00000100:00100000:2.0:1789635165.473673:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7139:x1876568421967232:12345-0@lo:502: Request processed in 314us (4998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.473690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789635165.474241:0:7139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7139:1876568421967232:0@lo:502: 00000040:00080000:1.0:1789635165.474282:0:7139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789635165.474612:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789635165.474633:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635165.474645:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.474656:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635165.474665:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789635165.474668:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79c8241800 from 4 10000000:01000000:2.0:1789635165.474671:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789635165.474717:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.474724:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.474742:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635165.474763:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967360:0@lo:101: 00000100:00100000:2.0:1789635165.474801:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.474881:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635165.475553:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421967360 00000100:00100000:0.0:1789635165.475561:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421967360 00000100:00100000:0.0:1789635165.475600:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789635165.475608:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421967360:12345-0@lo:101: 00010000:00010000:0.0:1789635165.475619:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635165.475635:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2b97 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635165.475660:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635165.475670:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635165.475833:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030400, rc 0) 00000100:00100000:0.0:1789635165.475924:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421967360:12345-0@lo:101: Request processed in 316us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635165.475941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789635165.477273:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967360:0@lo:101: 00010000:00010000:2.0:1789635165.477297:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.477420:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635165.478181:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967488:0@lo:256: 00000100:00100000:2.0:1789635165.478235:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.478359:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635165.478593:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421967488 00000100:00100000:0.0:1789635165.478602:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421967488 00000100:00100000:0.0:1789635165.481253:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635165.481285:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421967488:12345-0@lo:256: 20000000:01000000:0.0:1789635165.481356:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789635165.481385:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789635165.481389:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789635165.481903:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421967488:12345-0@lo:256: Request processed in 633us (3665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635165.481913:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789635165.482012:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967488:0@lo:256: 10000000:01000000:3.0:1789635165.482072:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789635165.482083:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.482096:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635165.482107:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789635165.482111:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789635165.482114:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789635165.482157:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.482166:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.482177:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635165.482198:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967616:0@lo:101: 00000100:00100000:3.0:1789635165.482249:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635165.483619:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe3ccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.483916:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421967616 00000100:00100000:2.0:1789635165.483925:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421967616 00000100:00100000:3.0:1789635165.484131:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789635165.484142:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421967616:12345-0@lo:101: 00010000:00010000:3.0:1789635165.484159:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635165.484178:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2ba5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.484203:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.484215:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.484224:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676400, rc 0) 00000100:00100000:3.0:1789635165.484274:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421967616:12345-0@lo:101: Request processed in 134us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635165.484280:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789635165.484487:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967616:0@lo:101: 00010000:00010000:3.0:1789635165.484518:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.484527:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635165.484589:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967744:0@lo:501: 00000100:00100000:3.0:1789635165.484620:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635165.484650:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe3ccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.484754:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421967744 00000100:00100000:2.0:1789635165.484758:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421967744 00000100:00100000:2.0:1789635165.484778:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789635165.484784:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421967744:12345-0@lo:501: 00000100:00100000:2.0:1789635165.485056:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421967744:12345-0@lo:501: Request processed in 271us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.485063:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789635165.485225:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967744:0@lo:501: 00000100:00100000:3.0:1789635165.485254:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967872:0@lo:503: 00000100:00100000:3.0:1789635165.485294:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635165.485340:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe3ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635165.485940:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421967872 00000100:00100000:0.0:1789635165.485947:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421967872 00000100:00100000:0.0:1789635165.486122:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789635165.486131:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421967872:12345-0@lo:503: 00000100:00100000:0.0:1789635165.486397:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421967872:12345-0@lo:503: Request processed in 267us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635165.486405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789635165.486679:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421967872:0@lo:503: 00000100:00100000:3.0:1789635165.494576:0:7140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7140:1876568421968000:0@lo:502: 00000100:00100000:3.0:1789635165.494668:0:7140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635165.494776:0:7140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe3cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635165.503099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968000 00000100:00100000:1.0:1789635165.503121:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968000 00000100:00100000:1.0:1789635165.503205:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635165.503216:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7140:x1876568421968000:12345-0@lo:502: 00000100:00100000:0.0:1789635165.503773:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7140:x1876568421968000:12345-0@lo:502: Request processed in 556us (9102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635165.503782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635165.504262:0:7140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7140:1876568421968000:0@lo:502: 00000020:01000000:1.0:1789635165.504336:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789635165.504345:0:7140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789635165.504353:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635165.504355:0:7140:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789635165.504361:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789635165.504365:0:7140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1789635165.504388:0:7140:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789635165.504390:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635165.504405:0:7140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e79fe9199c0) 00000020:00000080:1.0:1789635165.504428:0:7140:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789635165.504433:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789635165.504527:0:7140:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789635165.504534:0:7140:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789635165.504549:0:7140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb2bba 00010000:00080000:1.0:1789635165.504577:0:7140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79fe382800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789635165.504815:0:7140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789635165.585979:0:7140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789635165.586002:0:7140:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789635165.587191:0:7140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635165.587456:0:7140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635165.587528:0:7140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789635165.587624:0:7140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789635165.589980:0:7153:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635165.589990:0:7153:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789635165.590875:0:7140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789635165.591053:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789635165.591092:0:7140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789635165.591117:0:7140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb2bc1 00000100:00080000:3.0:1789635165.591128:0:7140:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635165.591141:0:7140:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e79fe382800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635165.591180:0:7140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fd5d4e00 x1876568421968128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635165.591244:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421968128:0@lo:8: 00000100:00100000:0.0:1789635165.591339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.591451:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968128 00000100:00100000:2.0:1789635165.591460:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968128 00000100:00100000:2.0:1789635165.591513:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635165.591521:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876568421968128:12345-0@lo:8: 00010000:00080000:2.0:1789635165.591546:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:2.0:1789635165.591574:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb2bc8 00002000:00100000:2.0:1789635165.591604:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e79e7879800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789635165.591609:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789635165.591612:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789635165.591761:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789635165.591919:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789635165.591942:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e79e7879000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789635165.592042:0:7140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789635165.592106:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635165.592111:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635165.592113:0:7140:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789635165.592116:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635165.592120:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635165.592122:0:7140:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789635165.592125:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789635165.592127:0:7140:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789635165.592152:0:7140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7140:1876568421968256:0@lo:502: 00000100:00100000:3.0:1789635165.592197:0:7140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635165.592229:0:7140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe3cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.592527:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876568421968128:12345-0@lo:8: Request processed in 1004us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.592536:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789635165.592652:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79fd5d4e00 x1876568421968128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635165.592720:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635165.592729:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789635165.592745:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789635165.592751:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789635165.592754:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fe382800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789635165.592804:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789635165.592810:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421968128:0@lo:8: 00000004:00080000:3.0:1789635165.592870:0:7153:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789635165.592925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968256 00000100:00100000:1.0:1789635165.592933:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968256 00000100:00100000:1.0:1789635165.592974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635165.592984:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7140:x1876568421968256:12345-0@lo:502: 00000004:00080000:3.0:1789635165.593017:0:7153:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 141412704703ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789635165.593213:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7140:x1876568421968256:12345-0@lo:502: Request processed in 230us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635165.593221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789635165.593727:0:7140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7140:1876568421968256:0@lo:502: 00000020:01000000:3.0:1789635165.593832:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635165.593839:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635165.593841:0:7140:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789635165.593846:0:7140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789635165.594160:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789635165.594184:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789635165.594195:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.594207:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635165.594219:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789635165.594222:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e79c61999c0 from 1 10000000:01000000:2.0:1789635165.594225:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789635165.594255:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.594263:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.594285:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635165.594302:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421968384:0@lo:101: 00000100:00100000:2.0:1789635165.594378:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.594404:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789635165.595157:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968384 00000100:00100000:3.0:1789635165.595166:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968384 00000100:00100000:3.0:1789635165.595212:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789635165.595221:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421968384:12345-0@lo:101: 00010000:00010000:3.0:1789635165.596124:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635165.596206:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2bcf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.596240:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.596253:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.596263:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175800, rc 0) 00000100:00100000:2.0:1789635165.596348:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421968384:12345-0@lo:101: Request processed in 1128us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.596355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789635165.596786:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421968384:0@lo:101: 00010000:00010000:3.0:1789635165.596804:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635165.596835:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635165.596907:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421968512:0@lo:501: 00000100:00100000:3.0:1789635165.596942:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635165.596991:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe3cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.597094:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968512 00000100:00100000:2.0:1789635165.597100:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968512 00000100:00100000:2.0:1789635165.597148:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789635165.597160:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421968512:12345-0@lo:501: 00000100:00100000:2.0:1789635165.597439:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421968512:12345-0@lo:501: Request processed in 283us (496us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635165.597448:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789635165.597741:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421968512:0@lo:501: 10000000:01000000:2.0:1789635165.597780:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789635165.597788:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635165.597800:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635165.648655:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789635165.701924:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1789635165.701952:0:7154:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789635165.701982:0:7154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421968768:0@lo:7: 00000100:00100000:2.0:1789635165.702044:0:7154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635165.702095:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968768 00000100:00100000:2.0:1789635165.702105:0:7154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635165.702105:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968768 00000100:00080000:2.0:1789635165.702139:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635165.702226:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421968640:0@lo:13: 00000100:00100000:3.0:1789635165.702263:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635165.702263:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635165.702355:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968640 00000100:00100000:0.0:1789635165.702360:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968640 00000100:00100000:0.0:1789635165.702392:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635165.702402:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568421968640:12345-0@lo:13: 00002000:00000024:0.0:1789635165.702439:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789635165.702508:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568421968640:12345-0@lo:13: Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635165.702515:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635165.702584:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7154:x1876568421968768:12345-0@lo:7: 00010000:00080000:3.0:1789635165.702594:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0f480 x1876568421968640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635165.702613:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421968640:0@lo:13: 00002000:00080000:1.0:1789635165.707544:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789635165.707552:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789635165.707747:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7154:x1876568421968768:12345-0@lo:7: Request processed in 5163us (5696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635165.707758:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789635165.707872:0:7154:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0f800 x1876568421968768/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789635181 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635165.707891:0:7154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421968768:0@lo:7: 00000004:00080000:2.0:1789635165.707906:0:7154:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789635165.707946:0:7154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421968896:0@lo:5: 00000100:00100000:2.0:1789635165.707978:0:7154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635165.708139:0:7154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635165.708273:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421968896 00000100:00100000:1.0:1789635165.708280:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421968896 00000100:00100000:1.0:1789635165.708374:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635165.708383:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7154:x1876568421968896:12345-0@lo:5: 00002000:00080000:1.0:1789635165.708405:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789635165.708418:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789635165.708776:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7154:x1876568421968896:12345-0@lo:5: Request processed in 393us (795us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789635165.708784:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789635165.708808:0:7154:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0f800 x1876568421968896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635181 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635165.708821:0:7154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421968896:0@lo:5: 00000004:00080000:3.0:1789635165.708830:0:7154:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789635165.708857:0:7154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421969024:0@lo:700: 00000100:00100000:3.0:1789635165.708884:0:7154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635165.708938:0:7154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe3cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635165.708938:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969024 00000100:00100000:1.0:1789635165.708943:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969024 00000100:00100000:1.0:1789635165.709003:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635165.709009:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7154:x1876568421969024:12345-0@lo:700: 00000100:00100000:1.0:1789635165.709030:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1876568421969152:0@lo:700: 00000100:00100000:1.0:1789635165.709053:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635165.709072:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbcce600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635165.709116:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969152 00000100:00100000:2.0:1789635165.709120:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969152 00000100:00100000:2.0:1789635165.709161:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635165.709169:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1876568421969152:12345-0@lo:700: 40000000:02000000:2.0:1789635165.739612:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789635165.749122:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1876568421969152:12345-0@lo:700: Request processed in 39941us (40053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635165.749147:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789635165.749398:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dbcb0e00 x1876568421969152/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789635181 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635165.749417:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1876568421969152:0@lo:700: 40000000:02000000:1.0:1789635165.749436:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1789635165.791678:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789635165.791709:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789635165.792126:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7154:x1876568421969024:12345-0@lo:700: Request processed in 83110us (83233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635165.792155:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789635165.792251:0:7154:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79fd5d5180 x1876568421969024/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789635181 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635165.792263:0:7154:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789635165.792283:0:7154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421969024:0@lo:700: 00000004:02000040:2.0:1789635165.813759:0:7154:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789635165.817296:0:7154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421969280:0@lo:5: 00000100:00100000:2.0:1789635165.817419:0:7154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635165.817526:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969280 00000100:00100000:0.0:1789635165.817536:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969280 00000100:00100000:0.0:1789635165.817593:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635165.817604:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7154:x1876568421969280:12345-0@lo:5: 00000100:00100000:2.0:1789635165.819696:0:7154:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b923c0 going to sleep for 11 seconds 00002000:00080000:1.0:1789635165.832928:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789635165.832952:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789635165.837983:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7154:x1876568421969280:12345-0@lo:5: Request processed in 20374us (20557us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789635165.837995:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789635165.838050:0:7154:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0e300 x1876568421969280/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635181 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635165.838070:0:7154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7154:1876568421969280:0@lo:5: 00000004:00080000:2.0:1789635165.838099:0:7154:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789635166.227493:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635167.255271:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789635167.885643:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789635168.275934:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635169.302298:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635170.323661:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635171.091762:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635171.091799:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421969408:0@lo:13: 00000100:00100000:2.0:1789635171.091868:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635171.091974:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969408 00000100:00100000:0.0:1789635171.091990:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969408 00000100:00100000:0.0:1789635171.092066:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635171.092078:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421969408:12345-0@lo:13: 00000100:00100000:3.0:1789635171.092085:0:6695:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789635171.092096:0:6695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1789635171.092115:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635171.092178:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421969408:12345-0@lo:13: Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635171.092191:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789635171.092213:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0c700 x1876568421969408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635171.092226:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789635171.092248:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421969408:0@lo:13: 00000100:00080000:2.0:1789635171.092275:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635171.093266:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421969536:0@lo:400: 00000100:00100000:1.0:1789635171.093289:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421969664:0@lo:400: 00000100:00100000:0.0:1789635171.093352:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635171.093393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635171.093432:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568421969792:0@lo:400: 00000100:00100000:1.0:1789635171.093456:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635171.093502:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969664 00000100:00100000:0.0:1789635171.093504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969792 00000100:00100000:0.0:1789635171.093511:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969792 00000100:00100000:1.0:1789635171.093527:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969664 00000100:00100000:0.0:1789635171.093556:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635171.093567:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568421969792:12345-0@lo:400: 00000100:00100000:0.0:1789635171.093614:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568421969792:12345-0@lo:400: Request processed in 50us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635171.093907:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969536 00000100:00100000:2.0:1789635171.093912:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969536 00000100:00100000:2.0:1789635171.093939:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789635171.093944:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3306:x1876568421969536:12345-0@lo:400: 00000100:00100000:2.0:1789635171.093978:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3306:x1876568421969536:12345-0@lo:400: Request processed in 34us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635171.093983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789635171.094011:0:5843:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789635171.094018:0:5843:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1789635171.094036:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635171.094166:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421969536:0@lo:400: 00000100:00100000:1.0:1789635171.094610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635171.094620:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635171.094626:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421969664:12345-0@lo:400: 00000100:00100000:1.0:1789635171.094684:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421969664:12345-0@lo:400: Request processed in 64us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635171.094691:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789635171.094751:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dbcb1180 x1876568421969792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635171.094766:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568421969792:0@lo:400: 00010000:00080000:1.0:1789635171.094799:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dbcb0e00 x1876568421969664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635171.094809:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421969664:0@lo:400: 00010000:00010000:3.0:1789635171.348866:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789635172.053265:0:7635:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789635172.053269:0:7635:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789635172.053418:0:7635:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e79fe5fc000 00000020:01000004:1.0:1789635172.053432:0:7635:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789635172.053445:0:7635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789635172.053459:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e79fe91cd40) 00000020:00000080:1.0:1789635172.053471:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789635172.063624:0:7635:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789635172.063843:0:7635:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789635172.075833:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789635172.080846:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789635172.080881:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789635172.081014:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789635172.081041:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789635172.081720:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789635172.081735:0:7635:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789635172.081748:0:7635:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x77332204cfbb2be4 00000020:01000004:2.0:1789635172.081757:0:7635:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789635172.081782:0:7635:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789635172.081786:0:7635:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789635172.081795:0:7635:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789635172.081826:0:7635:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789635172.081831:0:7635:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789635172.100069:0:7635:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789635172.100113:0:7635:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789635172.100117:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789635172.100119:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789635172.100121:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635172.100122:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635172.100123:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635172.100125:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635172.100126:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789635172.100128:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789635172.100129:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789635172.100131:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635172.100133:0:7635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635172.100137:0:7635:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789635172.100139:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789635172.100141:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789635172.100142:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789635172.100143:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789635172.100144:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789635172.100145:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789635172.100146:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789635172.100148:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789635172.100149:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789635172.100150:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789635172.100151:0:7635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789635172.100185:0:7635:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789635172.100208:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421969920:0@lo:253: 00000100:00100000:2.0:1789635172.100414:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.100535:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.100624:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421969920 00000100:00100000:3.0:1789635172.100634:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421969920 00000100:00100000:3.0:1789635172.100720:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635172.100732:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7635:x1876568421969920:12345-0@lo:253: 20000000:01000000:3.0:1789635172.100770:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789635172.100783:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789635172.100788:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789635172.100792:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789635172.101832:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635172.102064:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789635172.102079:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789635172.102119:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789635172.102128:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789635172.102158:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789635172.102220:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789635172.102633:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789635172.102652:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:3.0:1789635172.102655:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:3.0:1789635172.102686:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789635172.102694:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789635172.102735:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789635172.102742:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:3.0:1789635172.102774:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789635172.102784:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789635172.102817:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789635172.102871:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789635172.103612:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789635172.103628:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:3.0:1789635172.103630:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:3.0:1789635172.103666:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789635172.103674:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789635172.103705:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789635172.103712:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:3.0:1789635172.103760:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789635172.103770:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789635172.103817:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789635172.103849:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789635172.103871:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789635172.103874:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789635172.103878:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789635172.103892:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789635172.103894:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789635172.103930:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789635172.103933:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789635172.104829:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789635172.104899:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789635172.104928:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789635172.105221:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789635172.105266:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789635172.105577:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789635172.105591:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789635172.105593:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789635172.105984:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789635172.106030:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789635172.106082:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789635172.106600:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789635172.106637:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789635172.106666:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789635172.106676:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789635172.106678:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789635172.107000:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789635172.107186:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789635172.107222:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789635172.107292:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789635172.107304:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789635172.107306:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789635172.107943:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789635172.108006:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789635172.108067:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789635172.108292:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789635172.108457:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789635172.108530:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789635172.108547:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789635172.108549:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789635172.108560:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789635172.108586:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108607:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108622:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108627:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108630:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108634:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108639:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108680:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108691:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 16 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.108704:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970048:0@lo:104: 00000100:00100000:3.0:1789635172.108778:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635172.108894:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108903:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 16 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.108912:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970176:0@lo:104: 00010000:00010000:3.0:1789635172.108952:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108958:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 16 pid: 5835 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.108963:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970304:0@lo:104: 00010000:00010000:3.0:1789635172.108976:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.108981:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 16 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.108986:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970432:0@lo:104: 00010000:00010000:3.0:1789635172.108996:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.109000:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 16 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.109004:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970560:0@lo:104: 00000100:00100000:3.0:1789635172.109014:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.109222:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789635172.109243:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.109339:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.109470:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970048 00000100:00100000:0.0:1789635172.109479:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970048 00000100:00100000:2.0:1789635172.109481:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.109491:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.109522:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970176 00000100:00100000:0.0:1789635172.109526:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970176 00000100:00100000:0.0:1789635172.109537:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970304 00000100:00100000:0.0:1789635172.109540:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970304 00000100:00100000:0.0:1789635172.109549:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970432 00000100:00100000:0.0:1789635172.109551:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970432 00000100:00100000:0.0:1789635172.109561:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970560 00000100:00100000:0.0:1789635172.109563:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970560 00000100:00100000:3.0:1789635172.109576:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635172.109588:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79ecc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+7:5836:x1876568421970048:12345-0@lo:104: 00010000:00010000:3.0:1789635172.109604:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.109710:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635172.109716:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79ecc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+7:5836:x1876568421970048:12345-0@lo:104: Request processed in 132us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.109731:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635172.109782:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635172.109789:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:5836:x1876568421970176:12345-0@lo:104: 00010000:00010000:3.0:1789635172.109798:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.109838:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789635172.109844:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:5836:x1876568421970176:12345-0@lo:104: Request processed in 56us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.109850:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635172.109863:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635172.109869:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:5836:x1876568421970304:12345-0@lo:104: 00010000:00010000:3.0:1789635172.109876:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.109902:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789635172.109907:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:5836:x1876568421970304:12345-0@lo:104: Request processed in 39us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.109912:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635172.109923:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635172.109928:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:5836:x1876568421970432:12345-0@lo:104: 00010000:00010000:3.0:1789635172.109935:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.109961:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789635172.109965:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:5836:x1876568421970432:12345-0@lo:104: Request processed in 38us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.109976:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635172.109987:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635172.109992:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5836:x1876568421970560:12345-0@lo:104: 00010000:00010000:3.0:1789635172.109999:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.110024:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789635172.110029:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5836:x1876568421970560:12345-0@lo:104: Request processed in 37us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.110034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789635172.110087:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789635172.110095:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110103:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175600 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635172.110107:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110117:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635172.110125:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635172.110131:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635172.110171:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110179:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635172.110200:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110207:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02175600/0x77332204cfbb2bcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110219:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789635172.110223:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110228:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676a00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635172.110238:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110246:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.110246:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:1.0:1789635172.110257:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635172.110263:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635172.110281:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110287:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635172.110302:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110376:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1676a00/0x77332204cfbb2ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110391:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635172.110395:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110401:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635172.110405:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110411:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.110416:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635172.110423:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.110441:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635172.110443:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635172.110444:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.110458:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635172.110460:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789635172.110471:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635172.110481:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635172.110483:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110491:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635172.110498:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.110504:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110506:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02174e00/0x77332204cfbb2b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.110516:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635172.110524:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110527:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635172.110532:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635172.110532:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2b89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.110536:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635172.110544:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635172.110545:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635172.110547:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635172.110554:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421970688:0@lo:103: 00000100:00100000:1.0:1789635172.110598:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.110634:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635172.110640:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421971072:0@lo:103: 00000100:00100000:1.0:1789635172.110660:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.110690:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421970816:0@lo:103: 00000100:00100000:1.0:1789635172.110713:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789635172.110761:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789635172.110765:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79fb977800 from 30 10000000:01000000:3.0:1789635172.110768:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789635172.110792:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.110801:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.110810:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.110824:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421971200:0@lo:101: 00000100:00100000:3.0:1789635172.110857:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.110874:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.110889:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971200 00000100:00100000:3.0:1789635172.110894:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971200 00000100:00100000:3.0:1789635172.110926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789635172.110933:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421971200:12345-0@lo:101: 00010000:00010000:3.0:1789635172.110955:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635172.110969:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2bf2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.110998:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111008:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111021:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111034:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111044:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1677a00, rc 0) 00000100:00100000:3.0:1789635172.111074:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421971200:12345-0@lo:101: Request processed in 142us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.111081:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789635172.111126:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421971200:0@lo:101: 00010000:00010000:3.0:1789635172.111138:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111146:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.111208:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970688 00000100:00100000:1.0:1789635172.111212:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635172.111212:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970688 00000100:00100000:1.0:1789635172.111223:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421970944:0@lo:103: 00010000:00010000:0.0:1789635172.111233:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 18 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.111249:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.111265:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971072 00000100:00100000:0.0:1789635172.111269:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971072 00010000:00010000:0.0:1789635172.111284:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 19 pid: 5835 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.111291:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970816 00000100:00100000:1.0:1789635172.111298:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970816 00000100:00100000:0.0:1789635172.111298:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421970944 00000100:00100000:0.0:1789635172.111303:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421970944 00010000:00010000:0.0:1789635172.111332:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 21 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.111353:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635172.111361:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+21:3309:x1876568421970688:12345-0@lo:103: 00000100:00100000:3.0:1789635172.111368:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789635172.111379:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789635172.111383:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+21:3309:x1876568421971072:12345-0@lo:103: 00010000:00010000:0.0:1789635172.111386:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 21 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.111396:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 21 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111402:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635172.111408:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635172.111409:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 21 pid: 5835 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111421:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 21 pid: 5835 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.111434:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635172.111437:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+21:3309:x1876568421970688:12345-0@lo:103: Request processed in 77us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.111443:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635172.111455:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635172.111460:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3306:x1876568421970944:12345-0@lo:103: 00010000:00010000:0.0:1789635172.111466:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789635172.111467:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3309:x1876568421971072:12345-0@lo:103: Request processed in 89us (804us total) trans 0 rc 0/0 00010000:00010000:0.0:1789635172.111470:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 20 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.111484:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 20 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.111487:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789635172.111496:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635172.111517:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568421970944:12345-0@lo:103: Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.111521:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635172.111540:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421970944:0@lo:103: 00000100:00100000:0.0:1789635172.111559:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421971072:0@lo:103: 00000100:00100000:0.0:1789635172.111563:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421970688:0@lo:103: 00010000:00010000:2.0:1789635172.111605:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175800/0x77332204cfbb2bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2bcf expref: 18 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.111616:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970048:0@lo:104: 00000100:00100000:2.0:1789635172.111643:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970176:0@lo:104: 00010000:00010000:2.0:1789635172.111652:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2b89 expref: 17 pid: 5835 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.111662:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970304:0@lo:104: 00010000:00010000:2.0:1789635172.111671:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2b66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2b5f expref: 16 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.111679:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970432:0@lo:104: 00000100:00100000:2.0:1789635172.111687:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1876568421970560:0@lo:104: 00010000:00010000:2.0:1789635172.111709:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.111777:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 15 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.111803:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635172.111813:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:3306:x1876568421970816:12345-0@lo:103: 00010000:00010000:1.0:1789635172.111820:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635172.111824:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 15 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.111833:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 15 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.111844:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2ba5 expref: 15 pid: 5837 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.111853:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635172.111887:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:3306:x1876568421970816:12345-0@lo:103: Request processed in 77us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.111895:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635172.111899:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421970816:0@lo:103: 00010000:00010000:0.0:1789635172.112140:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635172.112187:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635172.112188:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635172.112245:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.112255:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635172.112259:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.112267:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635172.112274:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635172.112280:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635172.112300:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.112307:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635172.112368:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.112372:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421971328:0@lo:103: 00010000:00010000:3.0:1789635172.112385:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b3c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.112398:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635172.112402:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635172.112406:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635172.112408:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635172.112477:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971328 00000100:00100000:2.0:1789635172.112483:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971328 00010000:00010000:2.0:1789635172.112502:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 14 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.112537:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789635172.112544:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:3309:x1876568421971328:12345-0@lo:103: 00010000:00010000:2.0:1789635172.112553:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635172.112558:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 14 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112567:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 14 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112577:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02174600/0x77332204cfbb2b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2b35 expref: 14 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112590:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112598:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112613:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112621:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112628:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112634:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112649:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635172.112653:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112660:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112682:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112689:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.112708:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.112717:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5828:1876568421971456:0@lo:105: 00010000:00010000:0.0:1789635172.112727:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.112735:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789635172.112742:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789635172.112747:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.112872:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971456 00000100:00100000:0.0:1789635172.112876:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971456 00000100:00100000:2.0:1789635172.112886:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.112904:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635172.112909:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5828:x1876568421971456:12345-0@lo:105: 00010000:00010000:0.0:1789635172.112916:0:5825:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.112923:0:5825:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.112972:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.112979:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.113089:0:5825:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.113111:0:5825:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9e79c1676000) 00010000:00010000:3.0:1789635172.113138:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.113148:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.113153:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5828:x1876568421971456:12345-0@lo:105: Request processed in 241us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.113162:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635172.113276:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5828:1876568421971456:0@lo:105: 00010000:00010000:2.0:1789635172.113289:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.113298:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1677400/0x77332204cfbb2beb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.113309:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635172.113379:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:3309:x1876568421971328:12345-0@lo:103: Request processed in 835us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.113396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635172.113493:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421971584:0@lo:501: 00000100:00100000:3.0:1789635172.113530:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.113558:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.113574:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971584 00000100:00100000:3.0:1789635172.113578:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971584 00000100:00100000:3.0:1789635172.113607:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789635172.113615:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421971584:12345-0@lo:501: 00000100:00100000:3.0:1789635172.113749:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421971584:12345-0@lo:501: Request processed in 135us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.113757:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789635172.113797:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421971584:0@lo:501: 00000100:00100000:3.0:1789635172.113830:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421971712:0@lo:503: 00000100:00100000:3.0:1789635172.113874:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.113907:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971712 00000100:00100000:0.0:1789635172.113910:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421971328:0@lo:103: 00000100:00100000:3.0:1789635172.113919:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971712 00000100:00100000:3.0:1789635172.113942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789635172.113949:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421971712:12345-0@lo:503: 00000100:00100000:3.0:1789635172.114116:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421971712:12345-0@lo:503: Request processed in 167us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.114123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789635172.114155:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.114167:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421971712:0@lo:503: 00000100:00100000:3.0:1789635172.115662:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7643:1876568421971840:0@lo:502: 00000100:00100000:3.0:1789635172.115734:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.115794:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.115840:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971840 00000100:00100000:2.0:1789635172.115850:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971840 00000100:00100000:2.0:1789635172.117091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789635172.117107:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7643:x1876568421971840:12345-0@lo:502: 00000100:00100000:2.0:1789635172.117677:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7643:x1876568421971840:12345-0@lo:502: Request processed in 572us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.117685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789635172.117803:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7643:1876568421971840:0@lo:502: 00000100:00100000:2.0:1789635172.117879:0:7643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7643:1876568421971968:0@lo:502: 00000100:00100000:2.0:1789635172.117928:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.117952:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421971968 00000100:00100000:2.0:1789635172.117958:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421971968 00000100:00100000:2.0:1789635172.117992:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789635172.118000:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7643:x1876568421971968:12345-0@lo:502: 00000100:00100000:2.0:1789635172.118401:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:7643:x1876568421971968:12345-0@lo:502: Request processed in 401us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.118408:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789635172.118448:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498540 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.118461:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7643:1876568421971968:0@lo:502: 00000040:00080000:2.0:1789635172.118479:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789635172.118541:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789635172.118558:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635172.118569:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.118590:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635172.118600:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789635172.118603:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789635172.118606:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789635172.118631:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.118640:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.118650:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.118662:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972096:0@lo:101: 00000100:00100000:2.0:1789635172.118690:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.118706:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498540 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.118718:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972096 00000100:00100000:2.0:1789635172.118721:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972096 00000100:00100000:2.0:1789635172.118743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789635172.118749:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421972096:12345-0@lo:101: 00010000:00010000:2.0:1789635172.118758:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635172.118773:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2c00 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.118811:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.118833:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.118843:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820600, rc 0) 00000100:00100000:2.0:1789635172.118871:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421972096:12345-0@lo:101: Request processed in 122us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.118877:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789635172.118969:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972096:0@lo:101: 00010000:00010000:2.0:1789635172.118982:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.118997:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.119048:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972224:0@lo:501: 00000100:00100000:2.0:1789635172.119073:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.119212:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498540 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.119294:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972224 00000100:00100000:2.0:1789635172.119298:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972224 00000100:00100000:2.0:1789635172.120195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789635172.120208:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421972224:12345-0@lo:501: 00000100:00100000:2.0:1789635172.120503:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421972224:12345-0@lo:501: Request processed in 297us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.120511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789635172.120556:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972224:0@lo:501: 00000100:00100000:2.0:1789635172.120593:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972352:0@lo:503: 00000100:00100000:2.0:1789635172.120641:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.120664:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498540 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.120674:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972352 00000100:00100000:2.0:1789635172.120679:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972352 00000100:00100000:2.0:1789635172.120699:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789635172.120705:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421972352:12345-0@lo:503: 00000100:00100000:2.0:1789635172.120888:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421972352:12345-0@lo:503: Request processed in 181us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.120894:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789635172.120937:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972352:0@lo:503: 00000100:00100000:1.0:1789635172.123593:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7645:1876568421972480:0@lo:502: 00000100:00100000:1.0:1789635172.124145:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.124197:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972480 00000100:00100000:1.0:1789635172.124207:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972480 00000100:00100000:1.0:1789635172.124259:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789635172.124273:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:7645:x1876568421972480:12345-0@lo:502: 00000100:00100000:1.0:1789635172.125631:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:7645:x1876568421972480:12345-0@lo:502: Request processed in 1356us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.125653:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789635172.126164:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7af30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.126398:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7645:1876568421972480:0@lo:502: 00000020:01000000:1.0:1789635172.126442:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635172.126452:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635172.126455:0:7645:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789635172.126461:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789635172.126463:0:7645:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789635172.126497:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7645:1876568421972608:0@lo:502: 00000100:00100000:1.0:1789635172.126548:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.126582:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7af30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.126612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972608 00000100:00100000:0.0:1789635172.126622:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972608 00000100:00100000:0.0:1789635172.126669:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789635172.126680:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:7645:x1876568421972608:12345-0@lo:502: 00000100:00100000:0.0:1789635172.126864:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:7645:x1876568421972608:12345-0@lo:502: Request processed in 186us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.126872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789635172.126889:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7645:1876568421972608:0@lo:502: 00000020:01000000:1.0:1789635172.126910:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635172.126914:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635172.126916:0:7645:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789635172.126920:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789635172.127046:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789635172.127067:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789635172.127078:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.127091:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635172.127100:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789635172.127102:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79c8241800 from 30 10000000:01000000:1.0:1789635172.127104:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635172.127128:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.127138:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.127147:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.127155:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972736:0@lo:101: 00000100:00100000:1.0:1789635172.127424:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.127452:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7af30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.128167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972736 00000100:00100000:0.0:1789635172.128177:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972736 00000100:00100000:0.0:1789635172.128226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789635172.128235:0:5835:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1789635172.128238:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421972736:12345-0@lo:101: 00000100:00100000:1.0:1789635172.128248:0:5835:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00010000:00010000:0.0:1789635172.128255:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635172.128276:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2c0e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.128307:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.128433:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.128445:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031000, rc 0) 00000100:00100000:0.0:1789635172.128507:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421972736:12345-0@lo:101: Request processed in 271us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.128515:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789635172.128568:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972736:0@lo:101: 00010000:00010000:1.0:1789635172.128584:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.128620:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.128688:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972864:0@lo:501: 00000100:00100000:1.0:1789635172.128727:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.128763:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7af30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.128779:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972864 00000100:00100000:1.0:1789635172.128784:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972864 00000100:00100000:1.0:1789635172.128806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789635172.128814:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421972864:12345-0@lo:501: 00000100:00100000:1.0:1789635172.131342:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421972864:12345-0@lo:501: Request processed in 2522us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.131376:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789635172.131383:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972864:0@lo:501: 00000100:00100000:2.0:1789635172.131447:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972992:0@lo:503: 00000100:00100000:2.0:1789635172.131499:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.131539:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca723600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.131807:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421972992 00000100:00100000:1.0:1789635172.131815:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421972992 00000100:00100000:1.0:1789635172.131861:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789635172.131871:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421972992:12345-0@lo:503: 00000100:00100000:1.0:1789635172.132227:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421972992:12345-0@lo:503: Request processed in 357us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.132234:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789635172.133203:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421972992:0@lo:503: 00000100:00100000:3.0:1789635172.133929:0:7648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7648:1876568421973120:0@lo:502: 00000100:00100000:3.0:1789635172.133996:0:7648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.134041:0:7648:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.134115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421973120 00000100:00100000:1.0:1789635172.134123:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421973120 00000100:00100000:1.0:1789635172.134178:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789635172.134189:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7648:x1876568421973120:12345-0@lo:502: 00000100:00100000:1.0:1789635172.134481:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7648:x1876568421973120:12345-0@lo:502: Request processed in 293us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.134495:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789635172.134588:0:7648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7648:1876568421973120:0@lo:502: 00000100:00100000:3.0:1789635172.134636:0:7648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7648:1876568421973248:0@lo:502: 00000100:00100000:3.0:1789635172.134671:0:7648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.134697:0:7648:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.134705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421973248 00000100:00100000:1.0:1789635172.134710:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421973248 00000100:00100000:1.0:1789635172.134737:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789635172.134745:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7648:x1876568421973248:12345-0@lo:502: 00000100:00100000:1.0:1789635172.134896:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:7648:x1876568421973248:12345-0@lo:502: Request processed in 151us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.134904:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789635172.134963:0:7648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7648:1876568421973248:0@lo:502: 00000040:00080000:3.0:1789635172.134985:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789635172.135191:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789635172.135217:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789635172.135230:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.135242:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635172.135252:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789635172.135255:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789635172.135259:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789635172.135286:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.135307:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.135464:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.135481:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421973376:0@lo:101: 00000100:00100000:2.0:1789635172.135517:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.135545:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca723600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.135568:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421973376 00000100:00100000:1.0:1789635172.135574:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421973376 00000100:00100000:1.0:1789635172.135606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789635172.135614:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421973376:12345-0@lo:101: 00010000:00010000:1.0:1789635172.135632:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635172.135647:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2c1c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.135671:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.135683:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.135694:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85600, rc 0) 00000100:00100000:1.0:1789635172.135731:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421973376:12345-0@lo:101: Request processed in 118us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.135737:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789635172.135764:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421973376:0@lo:101: 00010000:00010000:3.0:1789635172.135779:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.135800:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.135848:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421973504:0@lo:501: 00000100:00100000:3.0:1789635172.135875:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.135895:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.135911:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421973504 00000100:00100000:1.0:1789635172.135916:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421973504 00000100:00100000:1.0:1789635172.136022:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789635172.136038:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421973504:12345-0@lo:501: 00000100:00100000:1.0:1789635172.136300:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421973504:12345-0@lo:501: Request processed in 262us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.136307:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789635172.136377:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421973504:0@lo:501: 00000100:00100000:1.0:1789635172.136405:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421973632:0@lo:503: 00000100:00100000:1.0:1789635172.136440:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.136471:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca472f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.136508:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421973632 00000100:00100000:2.0:1789635172.136514:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421973632 00000100:00100000:2.0:1789635172.136547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789635172.136555:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421973632:12345-0@lo:503: 00000100:00100000:2.0:1789635172.136695:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421973632:12345-0@lo:503: Request processed in 141us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.136702:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789635172.136725:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421973632:0@lo:503: 00000100:00100000:0.0:1789635172.137125:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7649:1876568421973760:0@lo:502: 00000100:00100000:0.0:1789635172.137164:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.137182:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c965e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.137199:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421973760 00000100:00100000:1.0:1789635172.137210:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421973760 00000100:00100000:1.0:1789635172.137290:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789635172.137298:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7649:x1876568421973760:12345-0@lo:502: 00000100:00100000:1.0:1789635172.137511:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7649:x1876568421973760:12345-0@lo:502: Request processed in 213us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.137518:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789635172.137527:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7649:1876568421973760:0@lo:502: 00000020:01000000:2.0:1789635172.137556:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789635172.137565:0:7649:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789635172.137574:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635172.137577:0:7649:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789635172.137589:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789635172.137594:0:7649:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:2.0:1789635172.137624:0:7649:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789635172.137627:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635172.137646:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e79e76a0000) 00000020:00000080:2.0:1789635172.137671:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789635172.137683:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789635172.137766:0:7649:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789635172.137773:0:7649:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789635172.137782:0:7649:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb2c31 00010000:00080000:2.0:1789635172.137814:0:7649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79fe707800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789635172.138057:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:2.0:1789635172.138806:0:7649:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789635172.138824:0:7649:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789635172.139856:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635172.140299:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635172.140853:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789635172.140988:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789635172.142293:0:7650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635172.142300:0:7650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789635172.146293:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635172.146358:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789635172.146407:0:7649:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789635172.146435:0:7649:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb2c38 00000100:00080000:0.0:1789635172.146449:0:7649:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789635172.146464:0:7649:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79fe707800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789635172.146513:0:7649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79c7b5d880 x1876568421973888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635172.146549:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421973888:0@lo:8: 00000100:00100000:0.0:1789635172.146636:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.146694:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421973888 00000100:00100000:2.0:1789635172.146705:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421973888 00000100:00080000:0.0:1789635172.146710:0:7649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789635172.146745:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635172.146755:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876568421973888:12345-0@lo:8: 00010000:00020000:2.0:1789635172.146776:0:6691:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789635172.146832:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876568421973888:12345-0@lo:8: Request processed in 76us (195us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789635172.146841:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789635172.146891:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fe707800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635172.146897:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789635172.146901:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421973888:0@lo:8: 00000020:01000000:0.0:1789635172.146976:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635172.146981:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635172.146983:0:7649:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789635172.146988:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635172.146993:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635172.146994:0:7649:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789635172.147007:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789635172.147010:0:7649:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789635172.147037:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7649:1876568421974016:0@lo:502: 00000100:00100000:0.0:1789635172.147088:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.147115:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974016 00000100:00100000:0.0:1789635172.147120:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974016 00000100:00100000:0.0:1789635172.147173:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635172.147181:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7649:x1876568421974016:12345-0@lo:502: 00000100:00100000:0.0:1789635172.147815:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7649:x1876568421974016:12345-0@lo:502: Request processed in 632us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.147825:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635172.147882:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c965e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.147899:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:7649:1876568421974016:0@lo:502: 00000020:01000000:0.0:1789635172.147924:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635172.147929:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635172.147930:0:7649:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789635172.147935:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789635172.147992:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789635172.148010:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789635172.148021:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.148034:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635172.148045:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789635172.148048:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e79c61999c0 from 1 10000000:01000000:0.0:1789635172.148051:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789635172.148079:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.148094:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.148105:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.148117:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421974144:0@lo:101: 00000100:00100000:0.0:1789635172.148147:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.148172:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c965e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.149160:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421974272:0@lo:400: 00000100:00100000:0.0:1789635172.149209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.149287:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635172.149296:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421974400:0@lo:400: 00000100:00100000:2.0:1789635172.149303:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974144 00000100:00100000:0.0:1789635172.149356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.149389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974272 00000100:00100000:0.0:1789635172.149396:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974272 00000100:00100000:0.0:1789635172.149439:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974400 00000100:00100000:0.0:1789635172.149443:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974400 00000100:00100000:0.0:1789635172.149464:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635172.149473:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421974272:12345-0@lo:400: 00000100:00100000:0.0:1789635172.149527:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421974272:12345-0@lo:400: Request processed in 54us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.149534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635172.149550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635172.149557:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421974400:12345-0@lo:400: 00000100:00100000:0.0:1789635172.149585:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421974400:12345-0@lo:400: Request processed in 29us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.149601:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789635172.149637:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dbcb1880 x1876568421974400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635172.149650:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421974400:0@lo:400: 00010000:00080000:0.0:1789635172.149660:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dbcb3480 x1876568421974272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635172.149669:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421974272:0@lo:400: 00000100:00100000:1.0:1789635172.149962:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421974528:0@lo:400: 00000100:00100000:1.0:1789635172.150022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.150061:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974528 00000100:00100000:1.0:1789635172.150065:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974528 00000100:00100000:1.0:1789635172.150096:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635172.150102:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421974528:12345-0@lo:400: 00000100:00100000:1.0:1789635172.150139:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421974528:12345-0@lo:400: Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.150145:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635172.150203:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974144 00010000:00080000:1.0:1789635172.150215:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dbcb3800 x1876568421974528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635172.150226:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421974528:0@lo:400: 00000100:00100000:2.0:1789635172.150243:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789635172.150254:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421974144:12345-0@lo:101: 00010000:00010000:2.0:1789635172.150275:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635172.150298:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2c3f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.150425:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.150440:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.150452:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821e00, rc 0) 00000100:00100000:2.0:1789635172.150498:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421974144:12345-0@lo:101: Request processed in 246us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.150504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789635172.150635:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421974144:0@lo:101: 00010000:00010000:0.0:1789635172.150652:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.150663:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.150789:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421974656:0@lo:501: 00000100:00100000:0.0:1789635172.150826:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.150853:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c965e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.150867:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974656 00000100:00100000:0.0:1789635172.150871:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974656 00000100:00100000:0.0:1789635172.150903:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789635172.150910:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421974656:12345-0@lo:501: 00000100:00100000:0.0:1789635172.151143:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421974656:12345-0@lo:501: Request processed in 232us (317us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635172.151150:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789635172.151179:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421974656:0@lo:501: 10000000:01000000:0.0:1789635172.151207:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789635172.151214:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.151222:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.189109:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7635:x1876568421969920:12345-0@lo:253: Request processed in 88367us (88788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.189126:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635172.189264:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421969920:0@lo:253: 10000000:01000000:3.0:1789635172.189284:0:7635:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789635172.189288:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635172.189290:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789635172.189292:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635172.189293:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789635172.189295:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635172.189297:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635172.189298:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635172.189300:0:7635:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789635172.189302:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635172.189303:0:7635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635172.189368:0:7635:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e79fe5fc000 from lustre-OST0001 10000000:01000000:3.0:1789635172.189399:0:7635:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789635172.189403:0:7635:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789635172.189413:0:7635:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e79c61999c0 local copy 00010000:00010000:3.0:1789635172.189425:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.189550:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421974784:0@lo:501: 00000100:00100000:3.0:1789635172.189592:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.189789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974784 00000100:00100000:0.0:1789635172.189798:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974784 00000100:00100000:3.0:1789635172.189963:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.190008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789635172.190020:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7635:x1876568421974784:12345-0@lo:501: 00000100:00100000:0.0:1789635172.190297:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7635:x1876568421974784:12345-0@lo:501: Request processed in 279us (704us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635172.190305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789635172.190440:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421974784:0@lo:501: 10000000:01000000:3.0:1789635172.190465:0:7635:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789635172.190494:0:7635:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789635172.190501:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.190511:0:7635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635172.190532:0:7635:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e79fe5fc000 10000000:01000000:3.0:1789635172.190538:0:7635:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789635172.190543:0:7635:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789635172.190546:0:7635:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789635172.190551:0:7635:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789635172.190554:0:7635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789635172.190580:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.190589:0:7635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.190598:0:7635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.190610:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421974912:0@lo:101: 00000100:00100000:3.0:1789635172.190639:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.190772:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.190861:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421974912 00000100:00100000:1.0:1789635172.190866:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421974912 00000100:00100000:1.0:1789635172.190907:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789635172.190915:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:7635:x1876568421974912:12345-0@lo:101: 00010000:00010000:1.0:1789635172.190924:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635172.190947:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2c4d expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.190971:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 17 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.190981:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 17 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.190990:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85a00, rc 0) 00000100:00100000:1.0:1789635172.191018:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421974912:12345-0@lo:101: Request processed in 105us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.191024:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789635172.191108:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421974912:0@lo:101: 00010000:00010000:3.0:1789635172.191120:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.191138:0:7635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.191198:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975040:0@lo:501: 00000100:00100000:3.0:1789635172.191223:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.191245:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.191280:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975040 00000100:00100000:0.0:1789635172.191285:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975040 00000100:00100000:0.0:1789635172.191332:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789635172.191339:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975040:12345-0@lo:501: 00000100:00100000:0.0:1789635172.191522:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975040:12345-0@lo:501: Request processed in 183us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.191529:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789635172.191561:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975040:0@lo:501: 00000100:00100000:0.0:1789635172.191589:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975168:0@lo:503: 00000100:00100000:0.0:1789635172.191627:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.191647:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c965e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.191659:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975168 00000100:00100000:0.0:1789635172.191663:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975168 00000100:00100000:0.0:1789635172.191692:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789635172.191700:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975168:12345-0@lo:503: 00000100:00100000:0.0:1789635172.191871:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975168:12345-0@lo:503: Request processed in 172us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.191879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789635172.192007:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975168:0@lo:503: 00000040:00080000:1.0:1789635172.192393:0:7635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635172.192461:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975296:0@lo:502: 00000100:00100000:1.0:1789635172.192493:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.192517:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d844d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.192576:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975296 00000100:00100000:0.0:1789635172.192581:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975296 00000100:00100000:0.0:1789635172.192613:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789635172.192621:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975296:12345-0@lo:502: 00000100:00100000:0.0:1789635172.192761:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975296:12345-0@lo:502: Request processed in 140us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.192768:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789635172.192857:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975296:0@lo:502: 00000040:00080000:1.0:1789635172.193119:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789635172.193169:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789635172.193205:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789635172.193252:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789635172.193287:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789635172.193367:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789635172.193392:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975424:0@lo:502: 00000100:00100000:1.0:1789635172.193430:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.193512:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d844d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635172.193612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975424 00000100:00100000:2.0:1789635172.193619:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975424 00000100:00100000:3.0:1789635172.193670:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789635172.193681:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975424:12345-0@lo:502: 00000100:00100000:3.0:1789635172.193840:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975424:12345-0@lo:502: Request processed in 162us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.193848:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789635172.193933:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975424:0@lo:502: 00000040:00080000:1.0:1789635172.194016:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789635172.194025:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789635172.194514:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789635172.194524:0:7653:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789635172.194532:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635172.194535:0:7653:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789635172.194542:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635172.194561:0:7653:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e79fe91b380) 00000020:00000080:1.0:1789635172.194587:0:7653:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789635172.194594:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789635172.194677:0:7653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79fe5fc000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789635172.194687:0:7653:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789635172.194694:0:7653:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x77332204cfbb2c62 00010000:00010000:1.0:1789635172.198500:0:7653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789635172.198897:0:7653:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789635172.201778:0:7653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789635172.202145:0:7653:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789635172.205886:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789635172.206511:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789635172.207922:0:7653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789635172.207937:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635172.207944:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635172.207947:0:7653:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789635172.207951:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635172.207956:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635172.207957:0:7653:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789635172.207960:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789635172.207962:0:7653:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789635172.208019:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635172.208022:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635172.208023:0:7653:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789635172.208026:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789635172.208264:0:7635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789635172.208291:0:7635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789635172.208422:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.208436:0:7635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635172.208445:0:7635:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fe5fc000 from 1 10000000:01000000:1.0:1789635172.208448:0:7635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635172.208501:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.208516:0:7635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.208532:0:7635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.208559:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975552:0@lo:101: 00000100:00100000:1.0:1789635172.208645:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.208729:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dc2a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.208798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975552 00000100:00100000:3.0:1789635172.208808:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975552 00000100:00100000:3.0:1789635172.208895:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789635172.208905:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:7635:x1876568421975552:12345-0@lo:101: 00010000:00010000:3.0:1789635172.208929:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635172.208943:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2c69 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.208974:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.208987:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.208997:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676200, rc 0) 00000100:00100000:3.0:1789635172.209051:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421975552:12345-0@lo:101: Request processed in 147us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.209058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789635172.209141:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975552:0@lo:101: 00010000:00010000:2.0:1789635172.209169:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.209180:0:7635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.209300:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975680:0@lo:501: 00000100:00100000:2.0:1789635172.209356:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.209531:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.209565:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975680 00000100:00100000:1.0:1789635172.209570:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975680 00000100:00100000:1.0:1789635172.209604:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789635172.209612:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421975680:12345-0@lo:501: 00000100:00100000:1.0:1789635172.209870:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421975680:12345-0@lo:501: Request processed in 258us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.209878:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789635172.209955:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975680:0@lo:501: 00000100:00100000:2.0:1789635172.209986:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975808:0@lo:503: 00000100:00100000:2.0:1789635172.210029:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.210048:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.210747:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975808 00000100:00100000:3.0:1789635172.210753:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975808 00000100:00100000:3.0:1789635172.210829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789635172.210838:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421975808:12345-0@lo:503: 00000100:00100000:3.0:1789635172.211222:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421975808:12345-0@lo:503: Request processed in 385us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.211241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789635172.211256:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975808:0@lo:503: 00000040:00080000:2.0:1789635172.211711:0:7635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789635172.211796:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975936:0@lo:502: 00000100:00100000:2.0:1789635172.211842:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.211917:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.216567:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421975936 00000100:00100000:0.0:1789635172.216585:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421975936 00000100:00100000:0.0:1789635172.216700:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789635172.216713:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421975936:12345-0@lo:502: 00000100:00100000:0.0:1789635172.217444:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421975936:12345-0@lo:502: Request processed in 731us (5599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.217455:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789635172.218354:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421975936:0@lo:502: 00000040:00080000:3.0:1789635172.218702:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789635172.218766:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789635172.218811:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976064:0@lo:502: 00000100:00100000:3.0:1789635172.218878:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.218923:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.218994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976064 00000100:00100000:1.0:1789635172.219003:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976064 00000100:00100000:1.0:1789635172.219055:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635172.219064:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421976064:12345-0@lo:502: 00000100:00100000:1.0:1789635172.219271:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421976064:12345-0@lo:502: Request processed in 207us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.219279:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635172.219357:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976064:0@lo:502: 00000040:00080000:1.0:1789635172.219438:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789635172.219448:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789635172.224613:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635172.224629:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635172.224632:0:7657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789635172.224638:0:7657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79fe5fc000 00000020:00000080:1.0:1789635172.224641:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635172.224658:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635172.224661:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635172.224663:0:7657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789635172.224666:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789635172.224980:0:7635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789635172.225012:0:7635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635172.225071:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.225084:0:7635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635172.225139:0:7635:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789635172.225143:0:7635:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e79fe5fc000 10000000:01000000:2.0:1789635172.225147:0:7635:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e79fe5fc000 10000000:01000000:2.0:1789635172.225218:0:7635:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635172.225226:0:7635:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79fe5fc000 from 1 10000000:01000000:2.0:1789635172.225229:0:7635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789635172.225274:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.225284:0:7635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.225298:0:7635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.225385:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976192:0@lo:101: 00000100:00100000:2.0:1789635172.225467:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.225512:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.225610:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976192 00000100:00100000:1.0:1789635172.225620:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976192 00000100:00100000:1.0:1789635172.225676:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789635172.225687:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421976192:12345-0@lo:101: 00010000:00010000:1.0:1789635172.225703:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635172.225719:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2c77 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.225748:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.225760:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.225770:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85e00, rc 0) 00000100:00100000:1.0:1789635172.225823:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976192:12345-0@lo:101: Request processed in 138us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.225831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789635172.225930:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976192:0@lo:101: 00010000:00010000:2.0:1789635172.225945:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635172.225954:0:7635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635172.226055:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976320:0@lo:501: 00000100:00100000:2.0:1789635172.226079:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.226106:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.226148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976320 00000100:00100000:3.0:1789635172.226233:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976320 00000100:00100000:3.0:1789635172.226271:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789635172.226278:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976320:12345-0@lo:501: 00000100:00100000:3.0:1789635172.226569:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976320:12345-0@lo:501: Request processed in 291us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.226576:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789635172.226657:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976320:0@lo:501: 00000100:00100000:2.0:1789635172.226686:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976448:0@lo:503: 00000100:00100000:2.0:1789635172.226724:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.226748:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635172.226806:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976448 00000100:00100000:1.0:1789635172.226812:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976448 00000100:00100000:1.0:1789635172.226844:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789635172.226851:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976448:12345-0@lo:503: 00000100:00100000:1.0:1789635172.227006:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976448:12345-0@lo:503: Request processed in 155us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.227013:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789635172.227106:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976448:0@lo:503: 00000040:00080000:2.0:1789635172.227523:0:7635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789635172.227593:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976576:0@lo:502: 00000100:00100000:2.0:1789635172.227627:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.227656:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.227713:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976576 00000100:00100000:3.0:1789635172.227719:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976576 00000100:00100000:3.0:1789635172.227747:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789635172.227755:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976576:12345-0@lo:502: 00000100:00100000:3.0:1789635172.227936:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976576:12345-0@lo:502: Request processed in 181us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.227944:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789635172.228012:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976576:0@lo:502: 00000040:00080000:2.0:1789635172.228530:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789635172.228588:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789635172.228619:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789635172.228663:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789635172.228697:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789635172.228742:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789635172.228776:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789635172.228807:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789635172.228850:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789635172.228899:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789635172.228935:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789635172.228980:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789635172.229011:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789635172.229040:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789635172.229094:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789635172.229133:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789635172.229590:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789635172.229648:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789635172.229681:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789635172.229714:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789635172.229760:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789635172.229794:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789635172.229825:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789635172.229869:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789635172.229903:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789635172.229953:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789635172.229997:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789635172.230029:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789635172.230058:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789635172.230113:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789635172.230223:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789635172.230265:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789635172.230295:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789635172.230567:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789635172.230614:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789635172.230659:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789635172.230693:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789635172.230747:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976704:0@lo:502: 00000100:00100000:2.0:1789635172.230832:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.230916:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.230962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976704 00000100:00100000:3.0:1789635172.230970:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976704 00000100:00100000:3.0:1789635172.231050:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789635172.231061:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976704:12345-0@lo:502: 00000100:00100000:3.0:1789635172.231456:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421976704:12345-0@lo:502: Request processed in 395us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.231465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789635172.231560:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421976704:0@lo:502: 00000040:00080000:0.0:1789635172.231641:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789635172.231659:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789635172.232372:0:7658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789635172.232392:0:7658:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e79f9194d40) 00000020:00000080:0.0:1789635172.232417:0:7658:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789635172.232501:0:7658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79fe5fc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789635172.232506:0:7658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79fe5fc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789635172.232517:0:7658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79fe5fc000 3 00010000:00080000:0.0:1789635172.232553:0:7658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79fdd1c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789635172.238801:0:7658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789635172.239027:0:7658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789635172.239075:0:7658:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789635172.239089:0:7658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x77332204cfbb2c8c 00000100:00080000:2.0:1789635172.239102:0:7658:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789635172.239116:0:7658:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e79fdd1c800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635172.239248:0:7658:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79c7a0f480 x1876568421976832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635172.239286:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876568421976832:0@lo:38: 00000100:00100000:2.0:1789635172.239397:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.239470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976832 00000100:00100000:2.0:1789635172.239479:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976832 00000100:00100000:2.0:1789635172.239513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635172.239522:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876568421976832:12345-0@lo:38: 00010000:00080000:2.0:1789635172.239550:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:2.0:1789635172.239582:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x77332204cfbb2c93 00000004:00100000:2.0:1789635172.239599:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789635172.239636:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2f8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635172.239686:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876568421976832:12345-0@lo:38: Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.239694:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789635172.239740:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0f480 x1876568421976832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635172.239752:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789635172.239761:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789635172.239769:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789635172.239774:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789635172.239776:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fdd1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789635172.239783:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876568421976832:0@lo:38: 00000100:00080000:2.0:1789635172.239799:0:7658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789635172.239862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635172.239867:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789635172.239869:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e79fe707800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635172.239874:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 147 00000100:00080000:2.0:1789635172.239878:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789635172.239883:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79fe707800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635172.239895:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79c7a0c700 x1876568421977344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635172.239920:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568421976960:0@lo:400: 00000100:00100000:2.0:1789635172.239946:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.239977:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421977088:0@lo:400: 00000100:00100000:2.0:1789635172.240003:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.240020:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635172.240026:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421977216:0@lo:400: 00000100:00100000:2.0:1789635172.240061:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.240089:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421977344:0@lo:8: 00000100:00100000:2.0:1789635172.240116:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.240143:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421976960 00000100:00100000:2.0:1789635172.240147:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421976960 00000100:00100000:2.0:1789635172.240190:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977088 00000100:00100000:2.0:1789635172.240194:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977088 00000100:00100000:2.0:1789635172.240210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635172.240217:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568421976960:12345-0@lo:400: 00000100:00100000:2.0:1789635172.240254:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568421976960:12345-0@lo:400: Request processed in 37us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.240261:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635172.240274:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635172.240280:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421977088:12345-0@lo:400: 00000100:00100000:2.0:1789635172.240330:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421977088:12345-0@lo:400: Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.240338:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635172.248541:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977216 00000100:00100000:2.0:1789635172.248560:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977216 00000100:00100000:2.0:1789635172.248613:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977344 00000100:00100000:2.0:1789635172.248617:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977344 00000100:00100000:2.0:1789635172.248635:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635172.248647:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421977216:12345-0@lo:400: 00000100:00100000:2.0:1789635172.248758:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421977216:12345-0@lo:400: Request processed in 114us (8696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635172.248766:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635172.248780:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635172.248785:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876568421977344:12345-0@lo:8: 00000100:00100000:2.0:1789635172.248840:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876568421977344:12345-0@lo:8: Request processed in 53us (8722us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789635172.248874:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789635172.248933:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0f480 x1876568421976960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635172.248950:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568421976960:0@lo:400: 00010000:00080000:2.0:1789635172.248987:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0ca80 x1876568421977216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635172.248998:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421977216:0@lo:400: 00010000:00080000:2.0:1789635172.249009:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79c7a0f100 x1876568421977088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635172.249016:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421977088:0@lo:400: 00000100:00100000:2.0:1789635172.249055:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789635172.249063:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fe707800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635172.249068:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789635172.249071:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421977344:0@lo:8: 00000040:00080000:3.0:1789635172.249840:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789635172.250003:0:7660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876568421977472:0@lo:901: 00000100:00100000:2.0:1789635172.250053:0:7660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635172.250088:0:7660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9640e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.251044:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977472 00000100:00100000:3.0:1789635172.251054:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977472 00000100:00100000:3.0:1789635172.251123:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635172.251135:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876568421977472:12345-0@lo:901: 00000100:00080000:2.0:1789635172.251430:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635172.251639:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876568421977472:12345-0@lo:901: Request processed in 505us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635172.251656:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789635172.251686:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dc2ca300 x1876568421977472/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789635188 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635172.251703:0:7660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876568421977472:0@lo:901: 00000020:01000000:0.0:1789635172.251855:0:7635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789635172.251888:0:7635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789635172.251992:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.252007:0:7635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789635172.252059:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789635172.252062:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635172.252063:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635172.252065:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635172.252066:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635172.252068:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635172.252069:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635172.252071:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635172.252072:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635172.252074:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635172.252075:0:7635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635172.252080:0:7635:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789635172.252083:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635172.252085:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635172.252086:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635172.252087:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635172.252089:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635172.252090:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635172.252091:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635172.252092:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789635172.252094:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789635172.252095:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635172.252096:0:7635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635172.252122:0:7635:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789635172.252137:0:7635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421977600:0@lo:253: 00000100:00100000:0.0:1789635172.252256:0:7635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635172.252300:0:7635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c965e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635172.252402:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977600 00000100:00100000:3.0:1789635172.252408:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977600 00000100:00100000:3.0:1789635172.252448:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789635172.252456:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:7635:x1876568421977600:12345-0@lo:253: 20000000:01000000:3.0:1789635172.252482:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789635172.252496:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789635172.275115:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789635172.276438:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789635172.284444:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789635172.284457:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789635172.284488:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.284512:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.284522:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.284575:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.284593:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 19 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.284610:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876568421977728:0@lo:104: 00000100:00100000:3.0:1789635172.284689:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635172.284759:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635172.284996:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977728 00000100:00100000:0.0:1789635172.285006:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977728 00000100:00100000:0.0:1789635172.285072:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635172.285084:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5858:x1876568421977728:12345-0@lo:104: 00010000:00010000:0.0:1789635172.285101:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635172.285173:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635172.285181:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:5858:x1876568421977728:12345-0@lo:104: Request processed in 99us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.285188:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789635172.285262:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635172.285270:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285279:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635172.285283:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285292:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635172.285300:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635172.285305:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635172.285381:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285388:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635172.285410:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285418:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b9e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635172.285458:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635172.285460:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635172.285476:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635172.285489:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421977856:0@lo:103: 00000100:00100000:1.0:1789635172.285524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635172.285560:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977856 00000100:00100000:1.0:1789635172.285565:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977856 00010000:00010000:1.0:1789635172.285585:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 20 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635172.285607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635172.285614:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3309:x1876568421977856:12345-0@lo:103: 00010000:00010000:1.0:1789635172.285626:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635172.285632:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 20 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285642:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 20 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285660:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285669:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635172.285686:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001518506s 00010000:00010000:1.0:1789635172.285690:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285708:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285715:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285722:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285728:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635172.285733:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285740:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285749:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635172.285759:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635172.285788:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3309:x1876568421977856:12345-0@lo:103: Request processed in 174us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635172.285794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635172.285835:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421977856:0@lo:103: 00010000:00010000:3.0:1789635172.285995:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2b97 expref: 19 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635172.286017:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876568421977728:0@lo:104: 00010000:00010000:3.0:1789635172.286031:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.286040:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.286047:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635172.286054:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb2c9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635172.297494:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:7635:x1876568421977600:12345-0@lo:253: Request processed in 45026us (45225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635172.297510:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789635172.299422:0:7635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ec8828bc-aabc-4548-96aa-655e15bcddbb:7635:1876568421977600:0@lo:253: 10000000:01000000:1.0:1789635172.299448:0:7635:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789635172.299452:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789635172.299454:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789635172.299455:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635172.299472:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635172.299474:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635172.299475:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635172.299477:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789635172.299478:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789635172.299480:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789635172.299481:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635172.299483:0:7635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789635172.299501:0:7635:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789635172.310883:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635172.311089:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789635172.311373:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635172.311554:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789635172.311768:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789635172.312013:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789635172.313250:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789635172.372172:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789635172.515053:0:7635:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789635172.515063:0:7635:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789635172.515101:0:7635:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789635172.515176:0:7635:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789635172.515193:0:7635:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789635172.515221:0:7635:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789635173.395539:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635174.421403:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635175.446555:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635176.215725:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421977984:0@lo:13: 00000100:00100000:1.0:1789635176.215791:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635176.215877:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421977984 00000100:00100000:3.0:1789635176.215885:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421977984 00000100:00100000:3.0:1789635176.215936:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635176.215943:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421977984:12345-0@lo:13: 00002000:00000024:3.0:1789635176.215975:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789635176.216027:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635176.216389:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421977984:12345-0@lo:13: Request processed in 445us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635176.216398:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789635176.216457:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dc2ca300 x1876568421977984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635176.216477:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421977984:0@lo:13: 00000001:02000400:2.0:1789635176.383250:0:8001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789635176.470251:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635177.491465:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635177.747650:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421978112:0@lo:400: 00000100:00100000:2.0:1789635177.747737:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635177.747907:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421978240:0@lo:400: 00000100:00100000:1.0:1789635177.747940:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421978112 00000100:00100000:1.0:1789635177.747950:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421978112 00000100:00100000:0.0:1789635177.747956:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635177.748006:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789635177.748016:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3306:x1876568421978112:12345-0@lo:400: 00000100:00100000:0.0:1789635177.748116:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421978240 00000100:00100000:0.0:1789635177.748122:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421978240 00000100:00100000:0.0:1789635177.748153:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635177.748161:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421978240:12345-0@lo:400: 00000100:00100000:0.0:1789635177.748226:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421978240:12345-0@lo:400: Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635177.748233:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789635177.748288:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d4e00 x1876568421978240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635177.748303:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421978240:0@lo:400: 00000100:00080000:3.0:1789635177.750399:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635177.750408:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789635177.750412:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79fe707800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635177.750424:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79fe707800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635177.750443:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fd5d7800 x1876568421978624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635177.750496:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635177.750506:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568421978752:0@lo:400: 00000100:00100000:3.0:1789635177.750554:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635177.750604:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3306:x1876568421978112:12345-0@lo:400: Request processed in 2587us (2865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635177.750613:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421978752 00000100:00100000:1.0:1789635177.750617:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789635177.750621:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421978752 00000100:00100000:1.0:1789635177.750658:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421978496:0@lo:400: 00000100:00100000:3.0:1789635177.750669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635177.750680:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568421978752:12345-0@lo:400: 00000100:00100000:1.0:1789635177.750690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635177.750717:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635177.750723:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568421978368:0@lo:400: 00000100:00100000:3.0:1789635177.750732:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568421978752:12345-0@lo:400: Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635177.750739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635177.750750:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635177.750762:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421978624:0@lo:8: 00000100:00100000:1.0:1789635177.750780:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421978368 00000100:00100000:1.0:1789635177.750785:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421978368 00000100:00100000:3.0:1789635177.750796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635177.750818:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635177.750834:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568421978368:12345-0@lo:400: 00010000:00080000:3.0:1789635177.750844:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d4000 x1876568421978752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635177.750858:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568421978752:0@lo:400: 00000100:00100000:1.0:1789635177.750875:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568421978368:12345-0@lo:400: Request processed in 43us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635177.750882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789635177.750913:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d5500 x1876568421978368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635177.750924:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568421978368:0@lo:400: 00000100:00080000:3.0:1789635177.750931:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635177.750966:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421978496 00000100:00100000:1.0:1789635177.750971:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421978496 00000100:00100000:1.0:1789635177.750999:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421978624 00000100:00100000:1.0:1789635177.751002:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421978624 00000100:00100000:1.0:1789635177.751013:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635177.751019:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421978496:12345-0@lo:400: 00000100:00100000:1.0:1789635177.751063:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421978496:12345-0@lo:400: Request processed in 35us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635177.751069:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635177.751084:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635177.751088:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876568421978624:12345-0@lo:8: 00010000:00080000:1.0:1789635177.751112:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1789635177.751143:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb2ca1 00002000:00100000:1.0:1789635177.751157:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e79dc0e7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789635177.751163:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789635177.751167:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789635177.751373:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1789635177.751415:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d4380 x1876568421978496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635177.751427:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421978496:0@lo:400: 00002000:00080000:1.0:1789635177.751579:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789635177.751601:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79dc0e7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635177.751653:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876568421978624:12345-0@lo:8: Request processed in 562us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635177.751661:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789635177.751690:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d7800 x1876568421978624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635177.751704:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789635177.751712:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789635177.751718:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789635177.751720:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fe707800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789635177.751739:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789635177.751745:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568421978624:0@lo:8: 00000004:00080000:0.0:1789635177.751773:0:7650:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789635177.752298:0:7650:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 153571985440ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789635177.757338:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421978112:0@lo:400: 00000004:00080000:2.0:1789635177.772111:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789635177.772217:0:7651:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789635177.772225:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635177.772262:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421978880:0@lo:13: 00000100:00100000:1.0:1789635177.772263:0:7651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979008:0@lo:7: 00000100:00100000:2.0:1789635177.772359:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635177.772366:0:7651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635177.772385:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421978880 00000100:00100000:3.0:1789635177.772393:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421978880 00000100:00100000:3.0:1789635177.772447:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635177.772458:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568421978880:12345-0@lo:13: 00000100:00100000:1.0:1789635177.772484:0:7651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2adcc0 going to sleep for 11 seconds 00002000:00000024:3.0:1789635177.772490:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789635177.772535:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568421978880:12345-0@lo:13: Request processed in 80us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635177.772548:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789635177.772554:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb1880 x1876568421978880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635177.772573:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421978880:0@lo:13: 00000100:00100000:3.0:1789635177.772585:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979008 00000100:00100000:3.0:1789635177.772591:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979008 00000100:00100000:3.0:1789635177.772620:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635177.772625:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7651:x1876568421979008:12345-0@lo:7: 00000100:00080000:2.0:1789635177.773436:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789635177.777121:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789635177.777130:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789635177.777241:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7651:x1876568421979008:12345-0@lo:7: Request processed in 4609us (4873us total) trans 0 rc 0/0 00010000:00080000:1.0:1789635177.777285:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb0000 x1876568421979008/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789635193 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635177.777297:0:7651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979008:0@lo:7: 00000004:00080000:1.0:1789635177.777322:0:7651:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789635177.777353:0:7651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979136:0@lo:5: 00000100:00100000:1.0:1789635177.777387:0:7651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635177.777423:0:7651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635177.777465:0:6693:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789635177.777476:0:6693:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789635177.777737:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979136 00000100:00100000:1.0:1789635177.777744:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979136 00000100:00100000:2.0:1789635177.777823:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635177.777837:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:7651:x1876568421979136:12345-0@lo:5: 00002000:00080000:2.0:1789635177.777867:0:8106:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789635177.777871:0:8106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789635177.778017:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635177.778133:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:7651:x1876568421979136:12345-0@lo:5: Request processed in 299us (743us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789635177.778141:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789635177.778161:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb0000 x1876568421979136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635193 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635177.778175:0:7651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979136:0@lo:5: 00000004:00080000:1.0:1789635177.778186:0:7651:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789635177.778211:0:7651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979264:0@lo:700: 00000100:00100000:1.0:1789635177.778265:0:7651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635177.778285:0:7651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635177.778304:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979264 00000100:00100000:2.0:1789635177.778342:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979264 00000100:00100000:2.0:1789635177.778382:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635177.778393:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7651:x1876568421979264:12345-0@lo:700: 00000100:00100000:2.0:1789635177.778421:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1876568421979392:0@lo:700: 00000100:00100000:2.0:1789635177.778452:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635177.778479:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7eea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635177.778535:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979392 00000100:00100000:3.0:1789635177.778540:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979392 00000100:00100000:3.0:1789635177.778584:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635177.778592:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1876568421979392:12345-0@lo:700: 40000000:02000000:0.0:1789635177.829779:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789635177.833158:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1876568421979392:12345-0@lo:700: Request processed in 54558us (54697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635177.833186:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789635177.833208:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dc2c9c00 x1876568421979392/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789635193 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635177.833225:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1876568421979392:0@lo:700: 40000000:02000000:2.0:1789635177.833241:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1789635177.865913:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789635177.865931:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789635177.866065:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7651:x1876568421979264:12345-0@lo:700: Request processed in 87669us (87793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635177.866079:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789635177.866179:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb2d80 x1876568421979264/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789635193 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635177.866197:0:7651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979264:0@lo:700: 00000004:02000040:0.0:1789635177.880865:0:7651:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789635177.884292:0:7651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979520:0@lo:5: 00000100:00100000:0.0:1789635177.884400:0:7651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635177.884460:0:7651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c965e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789635177.884545:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979520 00000100:00100000:1.0:1789635177.884554:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979520 00000100:00100000:1.0:1789635177.884612:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635177.884622:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7651:x1876568421979520:12345-0@lo:5: 00002000:00080000:1.0:1789635177.888210:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789635177.888231:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789635177.890486:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7651:x1876568421979520:12345-0@lo:5: Request processed in 5862us (6081us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789635177.890496:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789635177.890542:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79c7b5f480 x1876568421979520/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635193 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635177.890558:0:7651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789635177.890575:0:7651:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e79c7b5f480 x1876568421979520/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789635193 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635177.890588:0:7651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7651:1876568421979520:0@lo:5: 00000004:00080000:2.0:1789635177.890602:0:7651:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789635178.517107:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635179.540553:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789635179.595591:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789635180.563581:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635180.847235:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.847504:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410423680 00000100:00100000:0.0:1789635180.847518:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410423680 00000100:00100000:0.0:1789635180.847614:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:0.0:1789635180.847624:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2347:x1876568410423680:12345-192.168.201.30@tcp:250: 00010000:00080000:0.0:1789635180.847668:0:7647:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ee2f9f50-e99a-486f-bfef-c674f5dea4b8@192.168.201.30@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1789635180.847706:0:7647:0:(genops.c:1384:class_connect()) connect: client ee2f9f50-e99a-486f-bfef-c674f5dea4b8, cookie 0x77332204cfbb2ca8 00000100:00080000:0.0:1789635180.847859:0:7647:0:(import.c:65:import_set_state_nolock()) ffff9e79fdd1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635180.847966:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+5:2347:x1876568410423680:12345-192.168.201.30@tcp:250: Request processed in 342us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635180.847975:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:2.0:1789635180.853348:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.853417:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410423552 00000100:00100000:0.0:1789635180.853431:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410423552 00000100:00100000:0.0:1789635180.853512:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:0.0:1789635180.853532:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+5:5569:x1876568410423552:12345-192.168.201.30@tcp:101: 00010000:00010000:0.0:1789635180.853554:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635180.853575:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf28 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635180.853627:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635180.853641:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635180.853652:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635180.853728:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+6:5569:x1876568410423552:12345-192.168.201.30@tcp:101: Request processed in 207us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635180.853736:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:2.0:1789635180.855927:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635180.856198:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410423808 00000100:00100000:1.0:1789635180.856208:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410423808 00000100:00100000:1.0:1789635180.856273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:1.0:1789635180.856285:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+6:5569:x1876568410423808:12345-192.168.201.30@tcp:501: 00000100:00100000:1.0:1789635180.856743:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+6:5569:x1876568410423808:12345-192.168.201.30@tcp:501: Request processed in 458us (825us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789635180.856752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:2.0:1789635180.862799:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635180.862885:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410423936 00000100:00100000:1.0:1789635180.862899:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410423936 00000100:00100000:1.0:1789635180.862962:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:1.0:1789635180.862974:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+6:5569:x1876568410423936:12345-192.168.201.30@tcp:101: 00010000:00010000:1.0:1789635180.862995:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635180.863015:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.863049:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.863081:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.863092:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85000, rc 0) 00000100:00100000:1.0:1789635180.863165:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+7:5569:x1876568410423936:12345-192.168.201.30@tcp:101: Request processed in 189us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635180.863173:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1789635180.865809:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635180.865883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424064 00000100:00100000:1.0:1789635180.865902:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424064 00000100:00100000:1.0:1789635180.865959:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:1.0:1789635180.865971:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+7:5569:x1876568410424064:12345-192.168.201.30@tcp:501: 00000100:00100000:1.0:1789635180.866404:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5569:x1876568410424064:12345-192.168.201.30@tcp:501: Request processed in 434us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635180.866424:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:2.0:1789635180.873570:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.873650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424192 00000100:00100000:0.0:1789635180.873664:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424192 00000100:00100000:0.0:1789635180.873735:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:0.0:1789635180.873749:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5569:x1876568410424192:12345-192.168.201.30@tcp:503: 00000100:00100000:0.0:1789635180.874257:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5569:x1876568410424192:12345-192.168.201.30@tcp:503: Request processed in 510us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635180.874267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789635180.879556:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.879626:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424320 00000100:00100000:0.0:1789635180.879646:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424320 00000100:00100000:0.0:1789635180.879720:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:0.0:1789635180.879733:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5588:x1876568410424320:12345-192.168.201.30@tcp:502: 00000100:00100000:0.0:1789635180.880496:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5588:x1876568410424320:12345-192.168.201.30@tcp:502: Request processed in 762us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635180.880516:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:2.0:1789635180.897050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635180.897261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424448 00000100:00100000:1.0:1789635180.897274:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424448 00000100:00100000:1.0:1789635180.897414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:1.0:1789635180.897428:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5588:x1876568410424448:12345-192.168.201.30@tcp:502: 00000100:00100000:1.0:1789635180.898228:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5588:x1876568410424448:12345-192.168.201.30@tcp:502: Request processed in 799us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635180.898240:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:2.0:1789635180.905589:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635180.905668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424576 00000100:00100000:1.0:1789635180.905682:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424576 00000100:00100000:1.0:1789635180.905753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:1.0:1789635180.905766:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5569:x1876568410424576:12345-192.168.201.30@tcp:101: 00010000:00010000:1.0:1789635180.905805:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635180.905831:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b84c00/0x77332204cfbb2cbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf59 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.906511:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b84c00/0x77332204cfbb2cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf59 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.906534:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b84c00/0x77332204cfbb2cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf59 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.906545:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84c00, rc 0) 00000100:00100000:1.0:1789635180.906625:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5569:x1876568410424576:12345-192.168.201.30@tcp:101: Request processed in 861us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635180.906634:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:2.0:1789635180.911157:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.911387:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424704 00000100:00100000:0.0:1789635180.911420:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424704 00000100:00100000:0.0:1789635180.911493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:0.0:1789635180.911505:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5569:x1876568410424704:12345-192.168.201.30@tcp:256: 20000000:01000000:0.0:1789635180.911540:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789635180.911561:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789635180.911565:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789635180.911570:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789635180.911572:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789635180.913784:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5569:x1876568410424704:12345-192.168.201.30@tcp:256: Request processed in 2272us (2633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635180.913797:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1789635180.923632:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635180.923712:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424832 00000100:00100000:1.0:1789635180.923724:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424832 00000100:00100000:1.0:1789635180.923788:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:1.0:1789635180.923800:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5569:x1876568410424832:12345-192.168.201.30@tcp:101: 00010000:00010000:1.0:1789635180.923819:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635180.923840:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf60 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.923945:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.923958:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635180.923967:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635180.924048:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5569:x1876568410424832:12345-192.168.201.30@tcp:101: Request processed in 250us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635180.924054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:2.0:1789635180.927300:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635180.927532:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410424960 00000100:00100000:1.0:1789635180.927545:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410424960 00000100:00100000:1.0:1789635180.927653:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:1.0:1789635180.927664:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5569:x1876568410424960:12345-192.168.201.30@tcp:501: 00000100:00100000:1.0:1789635180.928001:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5569:x1876568410424960:12345-192.168.201.30@tcp:501: Request processed in 337us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635180.928010:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:2.0:1789635180.930423:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.930739:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425088 00000100:00100000:0.0:1789635180.930751:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425088 00000100:00100000:0.0:1789635180.930814:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1789635180.930823:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5569:x1876568410425088:12345-192.168.201.30@tcp:503: 00000100:00100000:0.0:1789635180.931267:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5569:x1876568410425088:12345-192.168.201.30@tcp:503: Request processed in 443us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635180.931276:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:2.0:1789635180.940911:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.941051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425216 00000100:00100000:0.0:1789635180.941065:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425216 00000100:00100000:0.0:1789635180.941142:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:0.0:1789635180.941155:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5592:x1876568410425216:12345-192.168.201.30@tcp:502: 00000100:00100000:0.0:1789635180.941568:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5592:x1876568410425216:12345-192.168.201.30@tcp:502: Request processed in 415us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635180.941575:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:3.0:1789635180.945214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635180.945392:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425344 00000100:00100000:2.0:1789635180.945462:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425344 00000100:00100000:2.0:1789635180.945626:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:2.0:1789635180.945638:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5592:x1876568410425344:12345-192.168.201.30@tcp:502: 00000100:00100000:2.0:1789635180.945984:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5592:x1876568410425344:12345-192.168.201.30@tcp:502: Request processed in 347us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635180.945993:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:3.0:1789635180.949639:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635180.949856:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425472 00000100:00100000:0.0:1789635180.949869:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425472 00000100:00100000:0.0:1789635180.949935:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1789635180.949945:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1876568410425472:12345-192.168.201.30@tcp:38: 00010000:00080000:0.0:1789635180.949983:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1789635180.950055:0:5844:0:(genops.c:1384:class_connect()) connect: client e05ee327-d920-4885-acb2-a26d789e134c, cookie 0x77332204cfbb2ccb 00000004:00100000:0.0:1789635180.950096:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789635180.950104:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789635180.979134:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9e79dc0e1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635180.979260:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2347:x1876568410425472:12345-192.168.201.30@tcp:38: Request processed in 29313us (29632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635180.979274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1789635181.333117:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635181.333152:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421979648:0@lo:13: 00000100:00100000:1.0:1789635181.333260:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635181.333344:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979648 00000100:00100000:3.0:1789635181.333355:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979648 00000100:00100000:3.0:1789635181.333446:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789635181.333466:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421979648:12345-0@lo:13: 00002000:00000024:3.0:1789635181.333517:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635181.333583:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421979648:12345-0@lo:13: Request processed in 128us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635181.333590:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789635181.333697:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dc2c9c00 x1876568421979648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635181.333719:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421979648:0@lo:13: 00000100:00080000:2.0:1789635181.334109:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789635181.588774:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635181.984293:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635181.984499:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635181.984671:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425728 00000100:00100000:1.0:1789635181.984674:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425600 00000100:00100000:3.0:1789635181.984688:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425728 00000100:00100000:1.0:1789635181.984700:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425600 00000100:00080000:2.0:1789635181.984771:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635181.984816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789635181.984830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1789635181.984842:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:0:x1876568410425600:12345-192.168.201.30@tcp:41: 00000100:00100000:2.0:1789635181.984851:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:5569:x1876568410425728:12345-192.168.201.30@tcp:41: 00000004:00000024:3.0:1789635181.984901:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000004:00000024:2.0:1789635181.984913:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1789635181.985072:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:5569:x1876568410425728:12345-192.168.201.30@tcp:41: Request processed in 223us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635181.985073:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:0:x1876568410425600:12345-192.168.201.30@tcp:41: Request processed in 236us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.985095:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1789635181.985107:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789635181.987084:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635181.987199:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425856 00000100:00100000:1.0:1789635181.987212:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425856 00000100:00100000:1.0:1789635181.987288:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789635181.987304:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:5569:x1876568410425856:12345-192.168.201.30@tcp:40: 00000100:00100000:1.0:1789635181.987468:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:5569:x1876568410425856:12345-192.168.201.30@tcp:40: Request processed in 169us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635181.987476:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1789635181.989938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635181.990016:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410425984 00000100:00100000:3.0:1789635181.990027:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410425984 00000100:00100000:3.0:1789635181.990301:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1789635181.990332:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1876568410425984:12345-192.168.201.30@tcp:8: 00010000:00080000:3.0:1789635181.990410:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:3.0:1789635181.990447:0:6691:0:(genops.c:1384:class_connect()) connect: client e05ee327-d920-4885-acb2-a26d789e134c, cookie 0x77332204cfbb2cd2 00002000:00100000:3.0:1789635181.990461:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e05ee327-d920-4885-acb2-a26d789e134c/ffff9e79cdff1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789635181.990474:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789635181.990944:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789635181.990979:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e79cdff6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635181.991060:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2347:x1876568410425984:12345-192.168.201.30@tcp:8: Request processed in 748us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635181.991068:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1789635181.991142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635181.991206:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410426240 00000100:00100000:1.0:1789635181.991212:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410426240 00000100:00100000:1.0:1789635181.991259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:0.0:1789635181.991260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635181.991273:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2349:x1876568410426240:12345-192.168.201.30@tcp:400: 00000100:00100000:1.0:1789635181.991339:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2349:x1876568410426240:12345-192.168.201.30@tcp:400: Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635181.991346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:0.0:1789635181.992016:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635181.992066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410426368 00000100:00100000:0.0:1789635181.992071:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410426368 00000100:00100000:0.0:1789635181.992104:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789635181.992114:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:5569:x1876568410426368:12345-192.168.201.30@tcp:33: 00000100:00100000:2.0:1789635181.997244:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410426112 00000100:00100000:2.0:1789635181.997285:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410426112 00000100:00100000:2.0:1789635181.997366:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789635181.997377:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1876568410426112:12345-192.168.201.30@tcp:8: 00010000:00080000:2.0:1789635181.997416:0:8106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1789635181.997454:0:8106:0:(genops.c:1384:class_connect()) connect: client e05ee327-d920-4885-acb2-a26d789e134c, cookie 0x77332204cfbb2cd9 00002000:00100000:2.0:1789635181.997468:0:8106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e05ee327-d920-4885-acb2-a26d789e134c/ffff9e79dc2f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789635181.997496:0:8106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789635181.997856:0:8106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789635181.997894:0:8106:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635181.997986:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2347:x1876568410426112:12345-192.168.201.30@tcp:8: Request processed in 609us (6729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635181.997995:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000004:00080000:1.0:1789635182.003254:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11060us 00000004:00200000:1.0:1789635182.013613:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789635182.013754:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:5569:x1876568410426368:12345-192.168.201.30@tcp:33: Request processed in 21633us (21730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635182.013771:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789635182.131079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635182.135363:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410426496 00000100:00100000:2.0:1789635182.135385:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410426496 00000100:00100000:3.0:1789635182.135647:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:3.0:1789635182.135663:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:5609:x1876568410426496:12345-192.168.201.30@tcp:101: 00010000:00010000:3.0:1789635182.135690:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635182.138369:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676e00/0x77332204cfbb2ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf8a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.138473:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2ce7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.138486:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.138503:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635182.138547:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635182.138566:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635182.138589:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.138619:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676e00/0x77332204cfbb2ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf8a expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.138641:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf8a expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.138650:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635182.138653:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635182.138657:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1677400, rc 0) 00000100:00100000:3.0:1789635182.139002:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:5609:x1876568410426496:12345-192.168.201.30@tcp:101: Request processed in 3342us (7936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635182.139011:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 10000000:01000000:1.0:1789635182.355454:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635182.355464:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79c8241800 from 5 10000000:01000000:1.0:1789635182.355468:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635182.355524:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635182.355537:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635182.355549:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635182.355591:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421979776:0@lo:101: 00000100:00100000:1.0:1789635182.355667:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635182.355745:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635182.355889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979776 00000100:00100000:2.0:1789635182.355907:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979776 00000100:00100000:2.0:1789635182.356052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789635182.356065:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421979776:12345-0@lo:101: 00010000:00010000:2.0:1789635182.356085:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635182.356105:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb2cf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2cee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.356140:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb2cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2cee expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.356152:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb2cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2cee expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635182.356193:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820a00, rc 0) 00000100:00100000:2.0:1789635182.356359:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421979776:12345-0@lo:101: Request processed in 297us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635182.356421:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789635182.356737:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421979776:0@lo:101: 00010000:00010000:3.0:1789635182.356758:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.356770:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635182.356846:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421979904:0@lo:256: 00000100:00100000:3.0:1789635182.356889:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635182.356926:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1789635182.356950:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421979904 00000100:00100000:1.0:1789635182.356961:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421979904 00000100:00100000:1.0:1789635182.357017:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789635182.357028:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421979904:12345-0@lo:256: 20000000:01000000:1.0:1789635182.357051:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789635182.357075:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789635182.357079:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789635182.357432:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421979904:12345-0@lo:256: Request processed in 405us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635182.357441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789635182.357590:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421979904:0@lo:256: 10000000:01000000:3.0:1789635182.357674:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789635182.357689:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.357699:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635182.611722:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635182.867893:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568421980032:0@lo:400: 00000100:00100000:1.0:1789635182.867982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635182.868258:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421980032 00000100:00100000:2.0:1789635182.868271:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421980032 00000100:00100000:1.0:1789635182.868295:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635182.868303:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421980416:0@lo:400: 00000100:00100000:1.0:1789635182.868367:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635182.868416:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421980288:0@lo:400: 00000100:00100000:3.0:1789635182.868477:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421980160:0@lo:400: 00000100:00100000:3.0:1789635182.868503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635182.868577:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635182.868585:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421980544:0@lo:13: 00000100:00100000:3.0:1789635182.868625:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635182.868658:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421980544 00000100:00100000:3.0:1789635182.868662:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421980544 00000100:00100000:3.0:1789635182.868711:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635182.868728:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421980544:12345-0@lo:13: 00002000:00000024:3.0:1789635182.868760:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635182.868805:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421980544:12345-0@lo:13: Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635182.868813:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789635182.868836:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789635182.868866:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d4a80 x1876568421980544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635182.868878:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789635182.868901:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421980544:0@lo:13: 00000100:00100000:3.0:1789635182.868934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421980160 00000100:00100000:3.0:1789635182.868945:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421980160 00000100:00100000:1.0:1789635182.869005:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635182.869030:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421980416 00000100:00100000:1.0:1789635182.869033:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421980416 00000100:00100000:1.0:1789635182.869123:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421980288 00000100:00100000:1.0:1789635182.869127:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421980288 00000100:00100000:1.0:1789635182.869150:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635182.869170:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421980416:12345-0@lo:400: 00000100:00100000:1.0:1789635182.869210:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421980416:12345-0@lo:400: Request processed in 42us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635182.869226:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635182.869240:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635182.869247:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421980288:12345-0@lo:400: 00000100:00100000:1.0:1789635182.869282:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421980288:12345-0@lo:400: Request processed in 35us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635182.869288:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789635182.869329:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79c7b5d180 x1876568421980288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635182.869339:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421980288:0@lo:400: 00010000:00080000:1.0:1789635182.869360:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7ec9880 x1876568421980416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635182.869368:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421980416:0@lo:400: 00000100:00080000:1.0:1789635182.869392:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635182.869704:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421980672:0@lo:400: 00000100:00100000:0.0:1789635182.869740:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635182.869769:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421980672 00000100:00100000:0.0:1789635182.869772:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421980672 00000100:00080000:1.0:1789635182.869827:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635182.872868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635182.872897:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421980672:12345-0@lo:400: 00000100:00100000:0.0:1789635182.873016:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421980672:12345-0@lo:400: Request processed in 133us (3273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635182.874233:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635182.874256:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635182.874275:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421980160:12345-0@lo:400: 00000100:00100000:0.0:1789635182.874296:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635182.874308:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568421980032:12345-0@lo:400: 00000100:00100000:0.0:1789635182.874428:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568421980032:12345-0@lo:400: Request processed in 123us (6445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635182.874435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635182.874577:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421980672:0@lo:400: 00000100:00100000:0.0:1789635182.874654:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568421980032:0@lo:400: 00000100:00100000:3.0:1789635182.874689:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421980160:12345-0@lo:400: Request processed in 435us (6182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635182.874698:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635182.874702:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421980160:0@lo:400: 00010000:00010000:1.0:1789635183.635525:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635183.861563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635183.861671:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410426624 00000100:00100000:3.0:1789635183.861685:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410426624 00000100:00100000:3.0:1789635183.861814:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789635183.861827:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:5661:x1876568410426624:12345-192.168.201.30@tcp:41: 00000004:00000024:3.0:1789635183.861877:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:3.0:1789635183.861962:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:5661:x1876568410426624:12345-192.168.201.30@tcp:41: Request processed in 132us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635183.861971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:1.0:1789635183.862714:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635183.865851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635183.866579:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410426752 00000100:00100000:0.0:1789635183.866591:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410426752 00000100:00100000:0.0:1789635183.866711:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1789635183.866723:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e05ee327-d920-4885-acb2-a26d789e134c+6:5661:x1876568410426752:12345-192.168.201.30@tcp:13: 00002000:00000024:0.0:1789635183.866764:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635183.866842:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e05ee327-d920-4885-acb2-a26d789e134c+6:5661:x1876568410426752:12345-192.168.201.30@tcp:13: Request processed in 121us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635183.866850:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00080000:1.0:1789635183.868918:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635183.869436:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635183.869495:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410426880 00000100:00100000:3.0:1789635183.869506:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410426880 00000100:00080000:1.0:1789635183.869562:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635183.869626:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1789635183.869651:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e05ee327-d920-4885-acb2-a26d789e134c+6:5661:x1876568410426880:12345-192.168.201.30@tcp:13: 00002000:00000024:3.0:1789635183.869690:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635183.869752:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e05ee327-d920-4885-acb2-a26d789e134c+6:5661:x1876568410426880:12345-192.168.201.30@tcp:13: Request processed in 116us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635183.869760:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000001:00100000:2.0:1789635183.927746:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00010000:00010000:0.0:1789635184.659500:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789635185.433051:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1789635185.508658:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00010000:00010000:0.0:1789635185.683402:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635186.456469:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635186.456497:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421980800:0@lo:13: 00000100:00100000:3.0:1789635186.456569:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635186.456675:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421980800 00000100:00100000:1.0:1789635186.456684:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421980800 00000100:00100000:1.0:1789635186.456757:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789635186.456767:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421980800:12345-0@lo:13: 00002000:00000024:1.0:1789635186.456801:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635186.456850:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421980800:12345-0@lo:13: Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635186.456862:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789635186.456926:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635186.456958:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d4a80 x1876568421980800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635186.456984:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421980800:0@lo:13: 00000001:00100000:2.0:1789635186.482192:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00010000:00010000:3.0:1789635186.709491:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635187.312177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635187.312220:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635187.312258:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635187.312283:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635187.312342:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427392 00000100:00100000:1.0:1789635187.312353:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427392 00000100:00100000:3.0:1789635187.312406:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427008 00000100:00100000:3.0:1789635187.312411:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427008 00000100:00100000:1.0:1789635187.312433:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427264 00000100:00100000:1.0:1789635187.312438:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427264 00000100:00100000:3.0:1789635187.312448:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:3.0:1789635187.312457:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410427008:12345-192.168.201.30@tcp:400: 00000100:00100000:1.0:1789635187.312469:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789635187.312479:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410427392:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1789635187.312519:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410427008:12345-192.168.201.30@tcp:400: Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635187.312524:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:2.0:1789635187.312573:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789635187.312584:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410427264:12345-192.168.201.30@tcp:400: 00000100:00100000:1.0:1789635187.312678:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410427392:12345-192.168.201.30@tcp:400: Request processed in 200us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635187.312685:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00080000:1.0:1789635187.312703:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635187.312708:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635187.312947:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427136 00000100:00100000:0.0:1789635187.312952:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427136 00000100:00100000:0.0:1789635187.313009:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789635187.313018:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410427136:12345-192.168.201.30@tcp:400: 00000100:00100000:0.0:1789635187.313085:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410427136:12345-192.168.201.30@tcp:400: Request processed in 59us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.313093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00080000:1.0:1789635187.313244:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635187.313278:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410427264:12345-192.168.201.30@tcp:400: Request processed in 695us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635187.313286:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00010000:00010000:1.0:1789635187.731508:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789635187.834745:0:8457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe59843540 20000000:00000080:3.0:1789635187.834766:0:8457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e79e7c19c00 uarg=0000000000000000 20000000:01000000:3.0:1789635187.834804:0:8457:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789635187.834807:0:8457:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789635187.834809:0:8457:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789635187.834815:0:8457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789635187.834821:0:8457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789635187.834838:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789635187.834841:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789635187.835027:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789635187.835030:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789635187.846599:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789635187.849797:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789635187.849875:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789635187.849909:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1789635187.849924:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789635187.849927:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789635187.850911:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789635187.851349:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789635187.851395:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789635187.851430:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789635187.851442:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789635187.851444:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789635187.852050:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789635187.852502:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789635187.852556:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789635187.852592:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789635187.852612:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789635187.852614:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789635187.854735:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789635187.856506:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789635187.856581:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789635187.856649:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1789635187.856669:0:8457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789635187.856691:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856710:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856718:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856725:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856731:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856738:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856745:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856751:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856761:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856787:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856795:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856841:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.856860:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 9 pid: 5837 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635187.856877:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421980928:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635187.857024:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.857032:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 9 pid: 5835 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635187.857041:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981056:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635187.857089:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.857097:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 18 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635187.857107:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981184:0@lo:104: 00000100:00100000:3.0:1789635187.864250:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789635187.864425:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.864441:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 18 pid: 7647 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635187.865213:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789635187.865238:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421981184 00000100:00100000:1.0:1789635187.865247:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421981184 00000100:00100000:1.0:1789635187.865345:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635187.865357:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:8457:x1876568421981184:12345-0@lo:104: 00010000:00010000:1.0:1789635187.865373:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.865463:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635187.865470:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:8457:x1876568421981184:12345-0@lo:104: Request processed in 116us (1230us total) trans 0 rc 0/0 00010000:00010000:2.0:1789635187.865483:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789635187.865491:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789635187.865494:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.865505:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820000 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:2.0:1789635187.865509:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.865516:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635187.865532:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635187.865536:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789635187.865568:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.865573:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635187.865589:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.865597:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79fe820000/0x77332204cfbb2c77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c7e expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.865611:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635187.865611:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421981440:0@lo:103: 00010000:00010000:2.0:1789635187.865615:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635187.865618:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635187.865657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635187.865694:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421981440 00000100:00100000:2.0:1789635187.865700:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421981440 00010000:00010000:2.0:1789635187.865723:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 19 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635187.865758:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635187.865767:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421981440:12345-0@lo:103: 00010000:00010000:2.0:1789635187.865780:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635187.865786:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 19 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.865797:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 19 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.865822:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635187.865862:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421981440:12345-0@lo:103: Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635187.865870:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635187.865913:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421981440:0@lo:103: 00000100:00100000:3.0:1789635187.867030:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981312:0@lo:104: 00000100:00100000:2.0:1789635187.867151:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635187.867225:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.867238:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 18 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635187.867251:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981568:0@lo:104: 00000100:00100000:2.0:1789635187.867278:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635187.867386:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.867390:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421981312 00000100:00100000:0.0:1789635187.867399:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421981312 00010000:00010000:2.0:1789635187.867401:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 18 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635187.867412:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981696:0@lo:104: 00000100:00100000:0.0:1789635187.867438:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421981568 00000100:00100000:0.0:1789635187.867443:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421981568 00000100:00100000:0.0:1789635187.867465:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789635187.867466:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.867481:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:8457:x1876568421981312:12345-0@lo:104: 00010000:00010000:0.0:1789635187.867495:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.867499:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.867514:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 18 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635187.867522:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981824:0@lo:104: 00000100:00100000:2.0:1789635187.867557:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635187.867575:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635187.867584:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:8457:x1876568421981312:12345-0@lo:104: Request processed in 109us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.867592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789635187.867596:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.867606:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 18 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.867610:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421981696 00000100:00100000:0.0:1789635187.867616:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421981696 00000100:00100000:2.0:1789635187.867622:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981952:0@lo:104: 00000100:00100000:0.0:1789635187.867630:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421981824 00000100:00100000:0.0:1789635187.867634:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421981824 00000100:00100000:0.0:1789635187.867654:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635187.867657:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.867665:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:8457:x1876568421981568:12345-0@lo:104: 00010000:00010000:0.0:1789635187.867674:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.867683:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635187.867706:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 18 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.867710:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789635187.867716:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421982080:0@lo:104: 00000100:00100000:0.0:1789635187.867727:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:8457:x1876568421981568:12345-0@lo:104: Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.867734:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635187.867747:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421981952 00000100:00100000:0.0:1789635187.867751:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421981952 00000100:00100000:2.0:1789635187.867752:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635187.867765:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635187.867769:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982080 00000100:00100000:0.0:1789635187.867773:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982080 00010000:00010000:2.0:1789635187.867786:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2c7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2c77 expref: 18 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.867791:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635187.867804:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981184:0@lo:104: 00000100:00100000:0.0:1789635187.867805:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:8457:x1876568421981696:12345-0@lo:104: 00000100:00100000:2.0:1789635187.867813:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981312:0@lo:104: 00010000:00010000:0.0:1789635187.867817:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635187.867820:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981568:0@lo:104: 00010000:00010000:0.0:1789635187.867869:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789635187.867874:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+6:8457:x1876568421981696:12345-0@lo:104: Request processed in 75us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.867880:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635187.867892:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635187.867898:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:8457:x1876568421981824:12345-0@lo:104: 00010000:00010000:0.0:1789635187.867905:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.867937:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789635187.867942:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:8457:x1876568421981824:12345-0@lo:104: Request processed in 45us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.867948:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635187.867959:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635187.867965:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:8457:x1876568421981952:12345-0@lo:104: 00010000:00010000:0.0:1789635187.867972:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868005:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789635187.868010:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:8457:x1876568421981952:12345-0@lo:104: Request processed in 46us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.868015:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635187.868026:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789635187.868031:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:8457:x1876568421982080:12345-0@lo:104: 00010000:00010000:0.0:1789635187.868039:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868075:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789635187.868080:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:8457:x1876568421982080:12345-0@lo:104: Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.868085:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1789635187.868102:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789635187.868108:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868115:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635187.868120:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868127:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635187.868133:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635187.868138:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635187.868172:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868179:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635187.868198:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635187.868201:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981696:0@lo:104: 00000100:00100000:2.0:1789635187.868214:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981824:0@lo:104: 00010000:00010000:0.0:1789635187.868214:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1677200/0x77332204cfbb2c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c54 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635187.868220:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981952:0@lo:104: 00000100:00100000:2.0:1789635187.868228:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421982080:0@lo:104: 00010000:00010000:0.0:1789635187.868239:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789635187.868244:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868250:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635187.868253:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868258:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635187.868264:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635187.868268:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635187.868282:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868287:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635187.868344:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868360:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c0030e00/0x77332204cfbb2c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868369:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789635187.868371:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868376:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635187.868380:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868386:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635187.868392:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635187.868396:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635187.868409:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868414:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635187.868419:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868425:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79fe821600/0x77332204cfbb2c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c23 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868433:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789635187.868440:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868446:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635187.868449:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868455:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635187.868461:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635187.868465:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635187.868478:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868483:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635187.868488:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868495:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c15 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868503:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635187.868506:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868512:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635187.868515:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868530:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635187.868536:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635187.868540:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635187.868551:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868555:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635187.868559:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868565:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb2c00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c07 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868573:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635187.868576:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868581:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676000 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635187.868584:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868589:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635187.868595:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635187.868604:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789635187.868615:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868621:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635187.868624:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868631:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1676000/0x77332204cfbb2bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2bf9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868643:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635187.868645:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635187.868646:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635187.868660:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421982464:0@lo:103: 00000100:00100000:0.0:1789635187.868691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.868718:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789635187.868723:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421982336:0@lo:103: 00000100:00100000:0.0:1789635187.868739:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.868756:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421982848:0@lo:103: 00000100:00100000:0.0:1789635187.868773:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.868811:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982464 00000100:00100000:0.0:1789635187.868815:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982464 00010000:00010000:0.0:1789635187.868834:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 18 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.868854:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982336 00000100:00100000:0.0:1789635187.868856:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982336 00010000:00010000:0.0:1789635187.868874:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 19 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.868885:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982848 00000100:00100000:0.0:1789635187.868887:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982848 00010000:00010000:0.0:1789635187.868896:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 20 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.868907:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635187.868912:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3307:x1876568421982464:12345-0@lo:103: 00010000:00010000:0.0:1789635187.868922:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635187.868927:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 20 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868936:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 20 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868947:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2c23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2c1c expref: 20 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.868960:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635187.868986:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568421982464:12345-0@lo:103: Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.868992:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635187.869004:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635187.869010:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3307:x1876568421982336:12345-0@lo:103: 00010000:00010000:0.0:1789635187.869016:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635187.869020:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 18 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869037:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 18 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869047:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb2c46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2c3f expref: 18 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869055:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635187.869091:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:3307:x1876568421982336:12345-0@lo:103: Request processed in 82us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.869097:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635187.869107:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635187.869113:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3307:x1876568421982848:12345-0@lo:103: 00010000:00010000:0.0:1789635187.869119:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635187.869123:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 16 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869131:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 16 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869142:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2bf2 expref: 16 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869151:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635187.869169:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:3307:x1876568421982848:12345-0@lo:103: Request processed in 57us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.869175:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635187.869196:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421982208:0@lo:103: 00000100:00100000:0.0:1789635187.869216:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.869237:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421982720:0@lo:103: 00000100:00100000:0.0:1789635187.869253:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.869265:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635187.869270:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421982592:0@lo:103: 00000100:00100000:0.0:1789635187.869284:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.869298:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982208 00000100:00100000:0.0:1789635187.869302:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982208 00010000:00010000:0.0:1789635187.869337:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 15 pid: 7647 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.869350:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982720 00000100:00100000:0.0:1789635187.869352:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982720 00010000:00010000:0.0:1789635187.869362:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 16 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.869371:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982592 00000100:00100000:0.0:1789635187.869373:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982592 00010000:00010000:0.0:1789635187.869381:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 17 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.869392:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635187.869397:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:3309:x1876568421982208:12345-0@lo:103: 00010000:00010000:0.0:1789635187.869404:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635187.869407:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 17 pid: 7647 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869415:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 17 pid: 7647 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869424:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2c4d expref: 17 pid: 7647 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869438:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635187.869465:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3309:x1876568421982208:12345-0@lo:103: Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.869471:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635187.869483:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635187.869489:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:3309:x1876568421982720:12345-0@lo:103: 00010000:00010000:0.0:1789635187.869496:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635187.869500:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 15 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869508:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 15 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869517:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2c07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2c00 expref: 15 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869526:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635187.869548:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:3309:x1876568421982720:12345-0@lo:103: Request processed in 59us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.869553:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635187.869564:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635187.869569:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:3309:x1876568421982592:12345-0@lo:103: 00010000:00010000:0.0:1789635187.869576:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635187.869580:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 13 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869586:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 13 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869602:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0031000/0x77332204cfbb2c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2c0e expref: 13 pid: 5837 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635187.869611:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635187.869634:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:3309:x1876568421982592:12345-0@lo:103: Request processed in 65us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.869640:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635187.869668:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421982592:0@lo:103: 00000100:00100000:0.0:1789635187.869676:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421982208:0@lo:103: 00000100:00100000:0.0:1789635187.869682:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421982720:0@lo:103: 00000100:00100000:0.0:1789635187.869707:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421982336:0@lo:103: 00000100:00100000:0.0:1789635187.869715:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421982848:0@lo:103: 00000100:00100000:0.0:1789635187.869722:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421982464:0@lo:103: 00010000:00010000:1.0:1789635187.869816:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635187.869925:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635187.869931:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635187.872752:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635187.872792:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635187.873194:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421980928:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635187.873224:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876568421981056:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635187.873276:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635187.873377:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427520 00000100:00100000:1.0:1789635187.873387:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427520 00010000:00010000:1.0:1789635187.873426:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 10 pid: 5837 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635187.873496:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427648 00000100:00100000:1.0:1789635187.873500:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427648 00010000:00010000:1.0:1789635187.873516:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 11 pid: 5835 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635187.873546:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1789635187.873555:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:2349:x1876568410427520:12345-192.168.201.30@tcp:103: 00010000:00010000:1.0:1789635187.873569:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635187.873575:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 11 pid: 5837 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873585:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 11 pid: 5837 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873603:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb2cb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf2f expref: 11 pid: 5837 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873618:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635187.873679:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2349:x1876568410427520:12345-192.168.201.30@tcp:103: Request processed in 125us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635187.873686:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1789635187.873725:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789635187.873732:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:2349:x1876568410427648:12345-192.168.201.30@tcp:103: 00010000:00010000:1.0:1789635187.873739:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635187.873743:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 9 pid: 5835 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873760:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 9 pid: 5835 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873770:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0030c00/0x77332204cfbb2caf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf28 expref: 9 pid: 5835 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873781:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873789:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873803:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873810:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873817:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873824:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873836:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635187.873841:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873854:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873868:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635187.873890:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635187.873911:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:2349:x1876568410427648:12345-192.168.201.30@tcp:103: Request processed in 179us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635187.873918:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00010000:00010000:3.0:1789635187.874522:0:8457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.874531:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635187.874537:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2cfc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635187.988489:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421983360:0@lo:400: 00000100:00100000:1.0:1789635187.988490:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421982976:0@lo:400: 00000100:00100000:1.0:1789635187.989087:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635187.989156:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568421983488:0@lo:400: 00000100:00100000:1.0:1789635187.989189:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635187.990136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421982976 00000100:00100000:2.0:1789635187.990149:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421982976 00000100:00100000:2.0:1789635187.990206:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421983488 00000100:00100000:2.0:1789635187.990210:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421983488 00000100:00100000:2.0:1789635187.990248:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635187.990259:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421982976:12345-0@lo:400: 00000100:00100000:1.0:1789635187.991133:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635187.991146:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568421983488:12345-0@lo:400: 00000100:00100000:0.0:1789635187.991528:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635187.991535:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568421983488:12345-0@lo:400: Request processed in 391us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635187.991544:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789635187.991578:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635187.991579:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568421983104:0@lo:400: 00000100:00100000:1.0:1789635187.991596:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421983360 00000100:00100000:0.0:1789635187.991618:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.991638:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421983616:0@lo:13: 00000100:00100000:1.0:1789635187.991654:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421983360 00000100:00100000:0.0:1789635187.991665:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635187.991688:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635187.991697:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421983232:0@lo:400: 00000100:00100000:0.0:1789635187.991719:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635187.991792:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421982976:12345-0@lo:400: Request processed in 1227us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635187.991801:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635187.991879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421983104 00000100:00100000:2.0:1789635187.991888:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421983104 00000100:00100000:2.0:1789635187.991918:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635187.991925:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568421983104:12345-0@lo:400: 00000100:00100000:2.0:1789635187.991959:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568421983104:12345-0@lo:400: Request processed in 35us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635187.991966:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635187.992248:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568421983104:0@lo:400: 00000100:00100000:0.0:1789635187.992282:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421983616 00000100:00100000:0.0:1789635187.992286:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421983616 00000100:00100000:1.0:1789635187.992295:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421983232 00000100:00100000:1.0:1789635187.992323:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421983232 00000100:00100000:0.0:1789635187.992344:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789635187.992368:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876568421983616:12345-0@lo:13: 00000100:00100000:3.0:1789635187.992428:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421982976:0@lo:400: 00000100:00100000:3.0:1789635187.992440:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568421983488:0@lo:400: 00002000:00000024:0.0:1789635187.992477:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635187.992513:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876568421983616:12345-0@lo:13: Request processed in 149us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635187.992519:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789635187.992547:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb2680 x1876568421983616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635187.992563:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421983616:0@lo:13: 00000100:00100000:1.0:1789635187.992908:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789635187.992918:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421983360:12345-0@lo:400: 00000100:00100000:3.0:1789635187.992926:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635187.992936:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421983232:12345-0@lo:400: 00000100:00100000:1.0:1789635187.992967:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421983360:12345-0@lo:400: Request processed in 51us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635187.992973:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635187.992993:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421983232:12345-0@lo:400: Request processed in 58us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635187.993000:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789635187.993110:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7ec9f80 x1876568421983360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635187.993121:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421983360:0@lo:400: 00000100:00080000:1.0:1789635187.993155:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635187.993161:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789635187.993277:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7ecad80 x1876568421983232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635187.993288:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421983232:0@lo:400: 00010000:00010000:0.0:1789635188.755474:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635189.166675:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635189.166804:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427776 00000100:00100000:2.0:1789635189.166816:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427776 00000100:00100000:2.0:1789635189.166902:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:2.0:1789635189.166914:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:5583:x1876568410427776:12345-192.168.201.30@tcp:101: 00010000:00010000:2.0:1789635189.166939:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635189.166961:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820000/0x77332204cfbb2d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf91 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.167009:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820000/0x77332204cfbb2d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf91 expref: 9 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.167021:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820000/0x77332204cfbb2d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf91 expref: 9 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.167050:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820000, rc 0) 00000100:00100000:2.0:1789635189.167119:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5583:x1876568410427776:12345-192.168.201.30@tcp:101: Request processed in 206us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.167126:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:1.0:1789635189.168617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635189.168696:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410427904 00000100:00100000:3.0:1789635189.168706:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410427904 00000100:00100000:3.0:1789635189.168759:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:3.0:1789635189.168779:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5583:x1876568410427904:12345-192.168.201.30@tcp:501: 00000100:00100000:3.0:1789635189.169079:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5583:x1876568410427904:12345-192.168.201.30@tcp:501: Request processed in 304us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635189.169087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:0.0:1789635189.170143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635189.170256:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428032 00000100:00100000:2.0:1789635189.170261:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428032 00000100:00100000:1.0:1789635189.170360:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:1.0:1789635189.170371:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5583:x1876568410428032:12345-192.168.201.30@tcp:503: 00000100:00100000:1.0:1789635189.170556:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5583:x1876568410428032:12345-192.168.201.30@tcp:503: Request processed in 188us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.170563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:1.0:1789635189.172139:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635189.172269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428160 00000100:00100000:3.0:1789635189.172278:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428160 00000100:00100000:3.0:1789635189.172347:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:3.0:1789635189.172359:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:6055:x1876568410428160:12345-192.168.201.30@tcp:502: 00000100:00100000:3.0:1789635189.172551:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:6055:x1876568410428160:12345-192.168.201.30@tcp:502: Request processed in 195us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635189.172556:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:3.0:1789635189.173829:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635189.173968:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428288 00000100:00100000:1.0:1789635189.173974:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428288 00000100:00100000:1.0:1789635189.174103:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:1.0:1789635189.174111:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:6055:x1876568410428288:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789635189.174305:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:6055:x1876568410428288:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 194us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.174330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:0.0:1789635189.177582:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635189.177665:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428416 00000100:00100000:2.0:1789635189.177676:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428416 00000100:00100000:2.0:1789635189.177759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:2.0:1789635189.177768:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5583:x1876568410428416:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635189.177783:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635189.177799:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821200/0x77332204cfbb2d0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.177831:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821200/0x77332204cfbb2d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf98 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.177838:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821200/0x77332204cfbb2d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf98 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.177845:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821200, rc 0) 00000100:00100000:2.0:1789635189.177918:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410428416:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 152us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.177924:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:0.0:1789635189.180417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635189.180489:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428544 00000100:00100000:2.0:1789635189.180497:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428544 00000100:00100000:2.0:1789635189.180577:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:2.0:1789635189.180584:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410428544:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.180854:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410428544:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 269us (446us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635189.180863:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 132 10000000:01000000:1.0:1789635189.331717:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789635189.331726:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79fe5fc000 from 39 10000000:01000000:1.0:1789635189.331731:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635189.331783:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.331795:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.331806:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635189.331831:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421983744:0@lo:101: 00000100:00100000:1.0:1789635189.331909:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.331992:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789635189.332080:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421983744 00000100:00100000:3.0:1789635189.332090:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421983744 00000100:00100000:3.0:1789635189.332151:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789635189.332164:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+12:5839:x1876568421983744:12345-0@lo:101: 00010000:00010000:3.0:1789635189.332178:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635189.332201:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d11 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.332227:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d11 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.332237:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d11 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.332246:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676400, rc 0) 00000100:00100000:3.0:1789635189.332345:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421983744:12345-0@lo:101: Request processed in 184us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635189.332352:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789635189.332465:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421983744:0@lo:101: 00010000:00010000:1.0:1789635189.332485:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.332494:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635189.332558:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421983872:0@lo:501: 00000100:00100000:1.0:1789635189.332586:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.332620:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.332703:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421983872 00000100:00100000:0.0:1789635189.332709:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421983872 00000100:00100000:0.0:1789635189.332742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789635189.332751:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421983872:12345-0@lo:501: 00000100:00100000:0.0:1789635189.332973:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421983872:12345-0@lo:501: Request processed in 224us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.332978:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789635189.333083:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421983872:0@lo:501: 00000100:00100000:1.0:1789635189.333118:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984000:0@lo:503: 00000100:00100000:1.0:1789635189.333349:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.333392:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635189.333523:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984000 00000100:00100000:2.0:1789635189.333529:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984000 00000100:00100000:2.0:1789635189.333560:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789635189.333567:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421984000:12345-0@lo:503: 00000100:00100000:2.0:1789635189.333770:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421984000:12345-0@lo:503: Request processed in 203us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.333778:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789635189.333840:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984000:0@lo:503: 00000100:00100000:3.0:1789635189.335164:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8473:1876568421984128:0@lo:502: 00000100:00100000:3.0:1789635189.335207:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.335247:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492000 going to sleep for 11 seconds 00000100:00100000:2.0:1789635189.335337:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984128 00000100:00100000:2.0:1789635189.335342:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984128 00000100:00100000:2.0:1789635189.335376:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789635189.335381:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:8473:x1876568421984128:12345-0@lo:502: 00000100:00100000:2.0:1789635189.335573:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:8473:x1876568421984128:12345-0@lo:502: Request processed in 191us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.335578:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789635189.335645:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8473:1876568421984128:0@lo:502: 00000100:00100000:3.0:1789635189.335682:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8473:1876568421984256:0@lo:502: 00000100:00100000:3.0:1789635189.335713:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.335747:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492000 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.335811:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984256 00000100:00100000:1.0:1789635189.335817:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984256 00000100:00100000:1.0:1789635189.335881:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789635189.335887:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:8473:x1876568421984256:12345-0@lo:502: 00000100:00100000:1.0:1789635189.336002:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:8473:x1876568421984256:12345-0@lo:502: Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.336010:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789635189.336081:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8473:1876568421984256:0@lo:502: 00000040:00080000:3.0:1789635189.336095:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789635189.336191:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789635189.336209:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789635189.336216:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.336225:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635189.336236:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789635189.336238:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789635189.336241:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789635189.336266:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.336274:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.336291:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635189.336299:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984384:0@lo:101: 00000100:00100000:3.0:1789635189.336344:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.338088:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492000 going to sleep for 11 seconds 00000100:00100000:2.0:1789635189.338131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984384 00000100:00100000:2.0:1789635189.338140:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984384 00000100:00100000:2.0:1789635189.338182:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789635189.338226:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+13:5839:x1876568421984384:12345-0@lo:101: 00010000:00010000:2.0:1789635189.338241:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635189.338256:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821a00/0x77332204cfbb2d26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d1f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.338282:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821a00/0x77332204cfbb2d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d1f expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.338293:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821a00/0x77332204cfbb2d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d1f expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.338302:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821a00, rc 0) 00000100:00100000:2.0:1789635189.338364:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421984384:12345-0@lo:101: Request processed in 141us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635189.338427:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984384:0@lo:101: 00010000:00010000:3.0:1789635189.338440:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.338448:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635189.338509:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984512:0@lo:501: 00000100:00100000:3.0:1789635189.338539:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.338559:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492000 going to sleep for 11 seconds 00000100:00100000:3.0:1789635189.338569:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984512 00000100:00100000:3.0:1789635189.338572:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984512 00000100:00100000:2.0:1789635189.339201:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789635189.339275:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789635189.339285:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421984512:12345-0@lo:501: 00000100:00100000:3.0:1789635189.339649:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421984512:12345-0@lo:501: Request processed in 365us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635189.339657:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789635189.339762:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984512:0@lo:501: 00000100:00100000:0.0:1789635189.339795:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984640:0@lo:503: 00000100:00100000:0.0:1789635189.339837:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635189.339908:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7eea180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.339948:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984640 00000100:00100000:1.0:1789635189.339954:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984640 00000100:00100000:1.0:1789635189.340030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789635189.340049:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421984640:12345-0@lo:503: 00000100:00100000:1.0:1789635189.340201:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421984640:12345-0@lo:503: Request processed in 159us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.340209:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789635189.340238:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421984640:0@lo:503: 00000100:00100000:3.0:1789635189.340615:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8474:1876568421984768:0@lo:502: 00000100:00100000:3.0:1789635189.340649:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635189.340692:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984768 00000100:00100000:0.0:1789635189.340698:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984768 00000100:00100000:0.0:1789635189.340727:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789635189.340734:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:8474:x1876568421984768:12345-0@lo:502: 00000100:00100000:3.0:1789635189.340783:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.340897:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:8474:x1876568421984768:12345-0@lo:502: Request processed in 162us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.340905:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789635189.340937:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8474:1876568421984768:0@lo:502: 00000020:01000000:3.0:1789635189.340962:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635189.340972:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635189.340975:0:8474:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789635189.340981:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789635189.341017:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8474:1876568421984896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635189.341059:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.341086:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.341261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421984896 00000100:00100000:0.0:1789635189.341266:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421984896 00000100:00100000:0.0:1789635189.341296:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789635189.341303:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:8474:x1876568421984896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635189.341569:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:8474:x1876568421984896:12345-0@lo:502:llog_process_th.0 Request processed in 265us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.341576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789635189.341750:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8474:1876568421984896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635189.341771:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635189.341776:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635189.341777:0:8474:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789635189.341781:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789635189.342118:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789635189.342141:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789635189.342149:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635189.342160:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635189.342182:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789635189.342184:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79fb977800 from 39 10000000:01000000:0.0:1789635189.342187:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635189.342213:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635189.342220:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635189.342229:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635189.342243:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.342274:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635189.342356:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7eead80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635189.342494:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985024 00000100:00100000:3.0:1789635189.342500:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985024 00000100:00100000:3.0:1789635189.342534:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789635189.342541:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:5839:x1876568421985024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635189.342551:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635189.342565:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2d34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d2d expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.342586:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d2d expref: 15 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.342597:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d2d expref: 15 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.342606:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676800, rc 0) 00000100:00100000:3.0:1789635189.342650:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421985024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.342805:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635189.342818:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.342827:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635189.342875:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.342901:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.342932:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.342995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985152 00000100:00100000:0.0:1789635189.343000:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985152 00000100:00100000:0.0:1789635189.343027:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789635189.343034:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.343261:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.343269:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789635189.343350:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.343381:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.343416:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.343441:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.343499:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985280 00000100:00100000:0.0:1789635189.343504:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985280 00000100:00100000:0.0:1789635189.343533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789635189.343540:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.343680:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.343693:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789635189.343808:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635189.343908:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789635189.344290:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8475:1876568421985408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635189.344346:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.344370:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.344422:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985408 00000100:00100000:0.0:1789635189.344427:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985408 00000100:00100000:0.0:1789635189.344459:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789635189.344467:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:8475:x1876568421985408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635189.344640:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:8475:x1876568421985408:12345-0@lo:502:llog_process_th.0 Request processed in 172us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.344648:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789635189.344823:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8475:1876568421985408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635189.344867:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8475:1876568421985536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635189.344905:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635189.344936:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c79859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.344985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985536 00000100:00100000:1.0:1789635189.344990:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985536 00000100:00100000:1.0:1789635189.345025:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789635189.345032:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:8475:x1876568421985536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635189.345186:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:8475:x1876568421985536:12345-0@lo:502:llog_process_th.0 Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.345193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789635189.345462:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8475:1876568421985536:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789635189.345483:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789635189.345625:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789635189.345643:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789635189.345652:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635189.345673:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635189.345685:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789635189.345687:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789635189.345690:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789635189.345714:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635189.345723:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635189.345733:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635189.345746:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.345781:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635189.345808:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7eead80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.345907:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985664 00000100:00100000:1.0:1789635189.345912:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985664 00000100:00100000:1.0:1789635189.345935:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789635189.345940:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:5839:x1876568421985664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635189.345946:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635189.345957:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b84000/0x77332204cfbb2d42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d3b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.345974:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b84000/0x77332204cfbb2d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d3b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.345981:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b84000/0x77332204cfbb2d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d3b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.345992:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84000, rc 0) 00000100:00100000:1.0:1789635189.346020:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.346025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789635189.346092:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635189.346107:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.346116:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635189.346164:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.346187:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635189.346233:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7364180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.346255:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985792 00000100:00100000:1.0:1789635189.346258:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985792 00000100:00100000:1.0:1789635189.346277:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789635189.346283:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.346611:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.346617:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789635189.346707:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.346735:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.346768:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635189.346826:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7364180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.346854:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421985920 00000100:00100000:1.0:1789635189.346858:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421985920 00000100:00100000:1.0:1789635189.346879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789635189.346889:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.347027:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421985920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.347032:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789635189.347086:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421985920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.347425:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8476:1876568421986048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635189.347457:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635189.347523:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7364d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.347552:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986048 00000100:00100000:0.0:1789635189.347556:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986048 00000100:00100000:0.0:1789635189.347613:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789635189.347620:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:8476:x1876568421986048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635189.347762:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:8476:x1876568421986048:12345-0@lo:502:llog_process_th.0 Request processed in 143us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.347769:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789635189.347823:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8476:1876568421986048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635189.347844:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635189.347853:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635189.347856:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789635189.347862:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789635189.347880:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8476:1876568421986176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635189.347908:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635189.348014:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04a0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.348069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986176 00000100:00100000:1.0:1789635189.348073:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986176 00000100:00100000:1.0:1789635189.348099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789635189.348104:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:8476:x1876568421986176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635189.348195:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:8476:x1876568421986176:12345-0@lo:502:llog_process_th.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.348201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789635189.348267:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8476:1876568421986176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635189.348280:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635189.348283:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635189.348284:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789635189.348290:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789635189.348410:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789635189.348428:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789635189.348435:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.348445:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635189.348456:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789635189.348458:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79c8241800 from 39 10000000:01000000:1.0:1789635189.348461:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635189.348481:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.348489:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.348498:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635189.348511:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.348536:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.348559:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635189.348594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986304 00000100:00100000:2.0:1789635189.348597:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986304 00000100:00100000:2.0:1789635189.348619:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789635189.348623:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421986304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635189.348629:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635189.348640:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821400/0x77332204cfbb2d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d49 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.348654:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821400/0x77332204cfbb2d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d49 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.348671:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821400/0x77332204cfbb2d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d49 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.348680:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821400, rc 0) 00000100:00100000:2.0:1789635189.348705:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421986304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.348710:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789635189.348810:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635189.348821:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.348829:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635189.348876:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.348898:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.348916:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635189.348960:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986432 00000100:00100000:2.0:1789635189.348964:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986432 00000100:00100000:2.0:1789635189.348990:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789635189.348997:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421986432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.349212:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421986432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.349219:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789635189.349284:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.349324:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.349354:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635189.349371:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecd89a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.349379:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986560 00000100:00100000:0.0:1789635189.349382:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986560 00000100:00100000:0.0:1789635189.349399:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789635189.349404:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421986560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.349645:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421986560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.349649:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789635189.350137:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635189.350560:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8477:1876568421986688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635189.350589:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.350637:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635189.350715:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986688 00000100:00100000:2.0:1789635189.350720:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986688 00000100:00100000:2.0:1789635189.350786:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789635189.350800:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8477:x1876568421986688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635189.350961:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8477:x1876568421986688:12345-0@lo:502:llog_process_th.0 Request processed in 163us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.350966:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789635189.351014:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8477:1876568421986688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635189.351054:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8477:1876568421986816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635189.351088:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.351109:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.351191:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986816 00000100:00100000:0.0:1789635189.351194:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986816 00000100:00100000:0.0:1789635189.351217:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789635189.351223:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8477:x1876568421986816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635189.351349:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8477:x1876568421986816:12345-0@lo:502:llog_process_th.0 Request processed in 126us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635189.351358:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789635189.353290:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8477:1876568421986816:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789635189.353346:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789635189.353597:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789635189.353619:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789635189.353630:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.353641:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635189.353652:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789635189.353655:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789635189.353658:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789635189.353709:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.353718:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.353729:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635189.353749:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635189.353812:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635189.353886:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789635189.354157:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421986944 00000100:00100000:3.0:1789635189.354164:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421986944 00000100:00100000:3.0:1789635189.354213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789635189.354222:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421986944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635189.354233:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635189.354246:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676a00/0x77332204cfbb2d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d57 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.354269:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676a00/0x77332204cfbb2d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d57 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.354279:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676a00/0x77332204cfbb2d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d57 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.354288:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676a00, rc 0) 00000100:00100000:3.0:1789635189.354365:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421986944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635189.354378:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789635189.354507:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421986944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635189.354521:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635189.354530:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635189.354578:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.354611:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635189.354640:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f24989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635189.354654:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421987072 00000100:00100000:2.0:1789635189.354658:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421987072 00000100:00100000:2.0:1789635189.355003:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789635189.355009:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421987072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.355276:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421987072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635189.355284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789635189.355343:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.355372:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.355409:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635189.355426:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f24989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635189.355492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421987200 00000100:00100000:3.0:1789635189.355496:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421987200 00000100:00100000:3.0:1789635189.355518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789635189.355524:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421987200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635189.355653:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421987200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635189.355659:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789635189.355850:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635189.356152:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8478:1876568421987328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635189.356178:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.356202:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.356214:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421987328 00000100:00100000:1.0:1789635189.356219:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421987328 00000100:00100000:1.0:1789635189.356249:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789635189.356255:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8478:x1876568421987328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635189.357180:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8478:x1876568421987328:12345-0@lo:502:llog_process_th.0 Request processed in 922us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.357189:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789635189.357280:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8478:1876568421987328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635189.357306:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789635189.357466:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635189.357469:0:8478:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789635189.357476:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789635189.357501:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8478:1876568421987456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635189.357537:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.357568:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.357618:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421987456 00000100:00100000:1.0:1789635189.357624:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421987456 00000100:00100000:1.0:1789635189.357698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789635189.357707:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8478:x1876568421987456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635189.357880:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8478:x1876568421987456:12345-0@lo:502:llog_process_th.0 Request processed in 175us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.357888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789635189.357946:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8478:1876568421987456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789635189.357964:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789635189.357968:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789635189.357970:0:8478:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789635189.357973:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789635189.358069:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789635189.358087:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789635189.358097:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.358107:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635189.358119:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789635189.358122:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e79c61999c0 from 1 10000000:01000000:2.0:1789635189.358125:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789635189.358150:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.358159:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.358168:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635189.358190:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635189.358218:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635189.358235:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7364180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635189.358254:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421987584 00000100:00100000:1.0:1789635189.358259:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421987584 00000100:00100000:1.0:1789635189.358378:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789635189.358387:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421987584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635189.358396:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635189.358410:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d65 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.358431:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d65 expref: 19 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.358441:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d65 expref: 19 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.358457:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85a00, rc 0) 00000100:00100000:1.0:1789635189.358526:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421987584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635189.358533:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789635189.358798:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635189.358820:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635189.358829:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635189.358873:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635189.358900:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635189.358931:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492480 going to sleep for 11 seconds 00000100:00100000:0.0:1789635189.358983:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421987712 00000100:00100000:0.0:1789635189.358988:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421987712 00000100:00100000:0.0:1789635189.359021:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789635189.359028:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421987712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635189.359333:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421987712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (409us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635189.359342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789635189.359424:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421987712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789635189.359445:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789635189.359451:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635189.359458:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635189.779701:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789635190.501592:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc98b1b30 20000000:00000080:2.0:1789635190.501612:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e79e73c4400 uarg=0000000000000000 20000000:01000000:2.0:1789635190.501653:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635190.501660:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635190.501665:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789635190.502358:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789635190.502470:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789635190.506728:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789635190.506787:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789635190.506848:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789635190.506866:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789635190.506888:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.506908:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85800/0x77332204cfbb2af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2aef expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.506917:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.506924:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.506933:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.506940:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.506982:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.507001:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 9 pid: 5836 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635190.507032:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421987840:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635190.507151:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.507159:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 18 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635190.507175:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421987968:0@lo:104: 00000100:00100000:0.0:1789635190.507221:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635190.507270:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.507278:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 18 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635190.507286:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421988096:0@lo:104: 00010000:00010000:0.0:1789635190.507306:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85800/0x77332204cfbb2af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2aef expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.507340:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79d3b85800/0x77332204cfbb2af6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2aef expref: 18 pid: 5836 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635190.507349:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421988224:0@lo:104: 00000100:00100000:2.0:1789635190.507365:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789635190.507378:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498240 going to sleep for 11 seconds 00000100:00100000:2.0:1789635190.507397:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635190.507423:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635190.507431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421987968 00000100:00100000:2.0:1789635190.507433:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988096 00000100:00100000:2.0:1789635190.507440:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988096 00000100:00100000:0.0:1789635190.507440:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421987968 00000100:00100000:2.0:1789635190.507485:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988224 00000100:00100000:2.0:1789635190.507488:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988224 00000100:00100000:0.0:1789635190.507766:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635190.507776:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:8515:x1876568421988096:12345-0@lo:104: 00010000:00010000:0.0:1789635190.507789:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.507847:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635190.507854:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:8515:x1876568421988096:12345-0@lo:104: Request processed in 80us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635190.507871:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635190.507875:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421988096:0@lo:104: 00000100:00100000:0.0:1789635190.507894:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635190.507900:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fdc90850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:8515:x1876568421987968:12345-0@lo:104: 00010000:00010000:0.0:1789635190.507907:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.507964:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421987968:0@lo:104: 00010000:00010000:0.0:1789635190.507996:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789635190.508003:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fdc90850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:8515:x1876568421987968:12345-0@lo:104: Request processed in 103us (782us total) trans 0 rc 0/0 00010000:00010000:1.0:1789635190.508611:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635190.508621:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508630:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677000 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635190.508634:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508643:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635190.508650:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635190.508657:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635190.508708:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508715:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635190.508742:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508750:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1677000/0x77332204cfbb2b51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2b58 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.508757:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421988352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635190.508785:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635190.508789:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508795:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635190.508798:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508805:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.508809:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789635190.508817:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635190.508823:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635190.508847:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508853:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635190.508874:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.508881:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb2c69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2c70 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.508882:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789635190.508895:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635190.508896:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421988480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635190.508899:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635190.508903:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635190.508925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635190.508926:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988352 00000100:00100000:1.0:1789635190.508939:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988352 00010000:00010000:1.0:1789635190.508965:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 19 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635190.508991:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988480 00000100:00100000:1.0:1789635190.508995:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988480 00000100:00100000:2.0:1789635190.509012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789635190.509027:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 20 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.509037:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3309:x1876568421988352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635190.509052:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635190.509060:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3307:x1876568421988480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635190.509061:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635190.509072:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 20 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.509073:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635190.509081:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 20 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.509092:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 20 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635190.509134:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635190.509172:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635190.509179:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:8515:x1876568421988224:12345-0@lo:104: 00010000:00010000:0.0:1789635190.509188:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.509231:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635190.509237:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:8515:x1876568421988224:12345-0@lo:104: Request processed in 60us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635190.509243:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789635190.509259:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635190.509264:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.509353:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635190.509356:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.509374:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635190.509380:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635190.509385:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789635190.509405:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.509411:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635190.509422:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.509428:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2aef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2af6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635190.509441:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635190.509443:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635190.509445:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635190.509462:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421988608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635190.509486:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635190.509986:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 20 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.510101:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2b58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2b51 expref: 20 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.510106:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676200/0x77332204cfbb2c70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2c69 expref: 20 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.510122:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635190.510200:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568421988480:12345-0@lo:103:ldlm_bl.0 Request processed in 1141us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635190.510208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789635190.510223:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635190.510230:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988608 00000100:00100000:1.0:1789635190.510236:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988608 00010000:00010000:1.0:1789635190.510254:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85800/0x77332204cfbb2af6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2aef expref: 18 pid: 5836 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.510264:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3309:x1876568421988352:12345-0@lo:103:ldlm_bl.0 Request processed in 1229us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635190.510271:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635190.510287:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3307:x1876568421988608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635190.510294:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635190.510298:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85800/0x77332204cfbb2af6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2aef expref: 18 pid: 5836 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.510303:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85800/0x77332204cfbb2af6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2aef expref: 18 pid: 5836 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.510322:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635190.510339:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3307:x1876568421988608:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635190.510393:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421988480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635190.510416:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568421988608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635190.510547:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789635190.510585:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421988352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635190.510617:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85800/0x77332204cfbb2af6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2aef expref: 17 pid: 5836 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635190.510620:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789635190.510635:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421988224:0@lo:104: 00010000:00010000:3.0:1789635190.511308:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635190.515284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635190.515444:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428672 00000100:00100000:1.0:1789635190.515455:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428672 00010000:00010000:1.0:1789635190.515494:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 10 pid: 5836 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635190.515579:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1789635190.515590:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410428672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635190.515605:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635190.515611:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 10 pid: 5836 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515625:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 10 pid: 5836 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515647:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515674:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515692:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515698:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515705:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515712:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515719:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635190.515724:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515731:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515741:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635190.515752:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635190.515810:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410428672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 222us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635190.515819:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00010000:00010000:2.0:1789635190.515942:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b84400/0x77332204cfbb2cc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf60 expref: 9 pid: 5836 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635190.515972:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876568421987840:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635190.516002:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.516011:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.516028:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.516035:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2d73 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635190.803651:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635191.571567:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421988736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635191.571661:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.572229:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988736 00000100:00100000:0.0:1789635191.572239:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988736 00000100:00100000:0.0:1789635191.572336:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789635191.572347:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421988736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635191.572387:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635191.572436:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421988736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.572443:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:01000000:2.0:1789635191.572559:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789635191.572564:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fe5fc000 from 4 10000000:01000000:2.0:1789635191.572568:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635191.572604:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.572614:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.572624:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635191.572641:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421988864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635191.572678:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635191.572702:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f91200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635191.572726:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988864 00000100:00100000:2.0:1789635191.572730:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988864 00000100:00100000:2.0:1789635191.572761:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789635191.572769:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421988864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635191.572780:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635191.572793:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d7a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.572830:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.572841:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.572850:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820400, rc 0) 00000100:00100000:2.0:1789635191.572890:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421988864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635191.572895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789635191.572945:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421988864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635191.572962:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.572971:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635191.573031:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421988992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635191.573069:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635191.573085:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f91200c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789635191.573720:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635191.573738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421988992 00000100:00100000:3.0:1789635191.573743:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421988992 00000100:00100000:3.0:1789635191.573781:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789635191.573792:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421988992:12345-0@lo:501:ll_cfg_requeue.0 00010000:00080000:1.0:1789635191.573857:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d5f80 x1876568421988736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635191.573876:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421988736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635191.574095:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421988992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635191.574104:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789635191.574122:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421988992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635191.574160:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635191.574206:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635191.574244:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f91200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635191.574308:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421989120 00000100:00100000:0.0:1789635191.574340:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421989120 00000100:00100000:0.0:1789635191.574374:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789635191.574382:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421989120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.574535:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421989120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.574542:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789635191.574703:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635191.576779:0:8595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8595:1876568421989248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635191.576848:0:8595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635191.576987:0:8595:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe70b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635191.577043:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421989248 00000100:00100000:0.0:1789635191.577050:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421989248 00000100:00100000:0.0:1789635191.577144:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789635191.577155:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8595:x1876568421989248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.577404:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8595:x1876568421989248:12345-0@lo:502:llog_process_th.0 Request processed in 251us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.577413:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789635191.577495:0:8595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8595:1876568421989248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635191.577521:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635191.577531:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635191.577534:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789635191.577541:0:8595:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79fe5fc000 00000020:00000080:2.0:1789635191.577544:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789635191.579106:0:8595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8595:1876568421989376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635191.579169:0:8595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635191.584177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421989376 00000100:00100000:3.0:1789635191.584191:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421989376 00000100:00100000:3.0:1789635191.584501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789635191.584512:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8595:x1876568421989376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635191.585076:0:8595:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635191.585581:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:8595:x1876568421989376:12345-0@lo:502:llog_process_th.0 Request processed in 1070us (6411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635191.585589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789635191.588728:0:8595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8595:1876568421989376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635191.588778:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635191.588787:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635191.588790:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789635191.588798:0:8595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789635191.588899:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789635191.588921:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635191.588932:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635191.588944:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635191.588966:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635191.588969:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fb977800 from 4 10000000:01000000:0.0:1789635191.588972:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635191.589015:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635191.589024:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635191.589036:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635191.589058:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.589122:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.589208:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635191.589246:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421989504 00000100:00100000:2.0:1789635191.589253:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421989504 00000100:00100000:2.0:1789635191.589346:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789635191.589356:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421989504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635191.589370:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635191.589383:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d88 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.589406:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.589428:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635191.589437:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821000, rc 0) 00000100:00100000:2.0:1789635191.589475:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421989504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635191.589482:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789635191.589557:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635191.589570:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635191.589579:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635191.589628:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.589651:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.589671:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635191.589685:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421989632 00000100:00100000:0.0:1789635191.589688:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421989632 00000100:00100000:0.0:1789635191.589718:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789635191.589725:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421989632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.589886:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421989632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.589893:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789635191.589922:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.589949:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.589983:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.589993:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f2498cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635191.590014:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421989760 00000100:00100000:0.0:1789635191.590018:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421989760 00000100:00100000:0.0:1789635191.590047:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789635191.590054:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421989760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.590196:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421989760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.590205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789635191.590246:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421989760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.590499:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8599:1876568421989888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.590533:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.590553:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421989888 00000100:00100000:0.0:1789635191.590557:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421989888 00000100:00100000:0.0:1789635191.590579:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789635191.590587:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8599:x1876568421989888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.590749:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8599:x1876568421989888:12345-0@lo:502:llog_process_th.0 Request processed in 162us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.590762:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789635191.590796:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635191.590809:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8599:1876568421989888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635191.590829:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635191.590838:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635191.590841:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789635191.590849:0:8599:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79fb977800 00000020:00000080:0.0:1789635191.590852:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789635191.590916:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8599:1876568421990016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.590957:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.590974:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635191.591015:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990016 00000100:00100000:3.0:1789635191.591021:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990016 00000100:00100000:3.0:1789635191.591057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789635191.591067:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8599:x1876568421990016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.591635:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8599:1876568421990016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635191.591637:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:8599:x1876568421990016:12345-0@lo:502:llog_process_th.0 Request processed in 571us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635191.591648:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000020:01000000:0.0:1789635191.591665:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635191.591693:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635191.591695:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789635191.591700:0:8599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789635191.592053:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789635191.592071:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635191.592080:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635191.592092:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635191.592104:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635191.592106:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79c8241800 from 4 10000000:01000000:1.0:1789635191.592110:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635191.592134:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635191.592142:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635191.592162:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635191.592178:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421990144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635191.592214:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635191.592246:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635191.592270:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990144 00000100:00100000:1.0:1789635191.592275:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990144 00000100:00100000:1.0:1789635191.592307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789635191.592341:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421990144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635191.592351:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635191.592365:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2d96 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635191.592387:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635191.592398:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635191.592407:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84600, rc 0) 00000100:00100000:1.0:1789635191.592442:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421990144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635191.592450:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789635191.592456:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421990144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635191.592471:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635191.592481:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635191.592520:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421990272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.592546:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.592570:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635191.592596:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990272 00000100:00100000:3.0:1789635191.592601:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990272 00000100:00100000:3.0:1789635191.592631:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789635191.592640:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421990272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635191.593074:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421990272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635191.593083:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789635191.593173:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421990272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635191.593214:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421990400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635191.593266:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635191.593285:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635191.593296:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990400 00000100:00100000:0.0:1789635191.593302:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990400 00000100:00100000:0.0:1789635191.593358:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789635191.593367:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421990400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.593527:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421990400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.593535:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789635191.593583:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421990400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635191.593746:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8601:1876568421990528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.593788:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635191.593809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990528 00000100:00100000:0.0:1789635191.593813:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990528 00000100:00100000:0.0:1789635191.593837:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789635191.593846:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:8601:x1876568421990528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.594056:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:8601:x1876568421990528:12345-0@lo:502:llog_process_th.0 Request processed in 211us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635191.594064:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789635191.594112:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f91200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635191.594127:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8601:1876568421990528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635191.594152:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635191.594161:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635191.594164:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789635191.594174:0:8601:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79c8241800 00000020:00000080:0.0:1789635191.594177:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789635191.594589:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8601:1876568421990656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635191.594631:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635191.594663:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990656 00000100:00100000:1.0:1789635191.594669:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990656 00000100:00100000:0.0:1789635191.594672:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f91200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635191.594706:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789635191.594717:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:8601:x1876568421990656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635191.594875:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:8601:x1876568421990656:12345-0@lo:502:llog_process_th.0 Request processed in 161us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635191.594883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789635191.594887:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:8601:1876568421990656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635191.594910:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635191.594915:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635191.594916:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789635191.594921:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789635191.595025:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789635191.595050:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789635191.595061:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635191.595073:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635191.827903:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635192.440655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635192.440702:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635192.440736:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635192.440762:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635192.440789:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428928 00000100:00100000:0.0:1789635192.440811:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428928 00000100:00100000:0.0:1789635192.440872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789635192.440882:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410428928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635192.440958:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410428928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635192.440966:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1789635192.441048:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410428800 00000100:00100000:1.0:1789635192.441053:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410428800 00000100:00100000:1.0:1789635192.441090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:1.0:1789635192.441101:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:2348:x1876568410428800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635192.441147:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:2348:x1876568410428800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 49us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635192.441153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:1.0:1789635192.441188:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429056 00000100:00100000:1.0:1789635192.441193:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429056 00000100:00100000:1.0:1789635192.441220:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429184 00000100:00100000:1.0:1789635192.441222:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429184 00000100:00100000:1.0:1789635192.441243:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789635192.441250:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410429056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635192.441281:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410429056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635192.441299:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789635192.441357:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1789635192.441365:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410429184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635192.441392:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410429184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635192.441398:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00080000:3.0:1789635192.441420:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635192.441424:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635192.441427:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635192.494265:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635192.494395:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429312 00000100:00100000:2.0:1789635192.494407:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429312 00000100:00100000:2.0:1789635192.494450:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:2.0:1789635192.494461:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:5583:x1876568410429312:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635192.494481:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635192.494502:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cf9f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635192.494531:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635192.494541:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635192.494548:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820600, rc 0) 00000100:00100000:2.0:1789635192.494596:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410429312:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 138us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635192.494601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:0.0:1789635192.500262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635192.500355:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429440 00000100:00100000:3.0:1789635192.500366:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429440 00000100:00100000:3.0:1789635192.500464:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:3.0:1789635192.500477:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410429440:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635192.500778:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410429440:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 303us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635192.500795:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:0.0:1789635192.506751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635192.506824:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429568 00000100:00100000:2.0:1789635192.506835:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429568 00000100:00100000:2.0:1789635192.506900:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:2.0:1789635192.506911:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410429568:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635192.507184:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:5583:x1876568410429568:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 275us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635192.507192:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:1.0:1789635192.516230:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635192.516683:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429696 00000100:00100000:0.0:1789635192.516696:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429696 00000100:00100000:0.0:1789635192.516754:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:0.0:1789635192.516765:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:6249:x1876568410429696:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635192.517045:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:6249:x1876568410429696:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 281us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635192.517053:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:0.0:1789635192.523001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635192.523363:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429824 00000100:00100000:3.0:1789635192.523375:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429824 00000100:00100000:3.0:1789635192.523433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:3.0:1789635192.523446:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:6249:x1876568410429824:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635192.523708:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:6249:x1876568410429824:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 264us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635192.523717:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 185 00010000:00010000:0.0:1789635192.851488:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635193.108669:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421990784:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.108749:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635193.108797:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421991296:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.108840:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635193.108867:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635193.108872:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421991168:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.108892:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635193.108916:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568421991040:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.108939:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635193.108955:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789635193.108960:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421990912:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.108992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635193.109010:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568421991424:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109031:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635193.109062:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990784 00000100:00100000:0.0:1789635193.109070:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990784 00000100:00100000:0.0:1789635193.109125:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789635193.109135:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568421990784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109188:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568421990784:12345-0@lo:400:kworker.0 Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635193.109195:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789635193.109231:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991296 00000100:00100000:0.0:1789635193.109234:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991296 00000100:00100000:0.0:1789635193.109265:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991168 00000100:00100000:0.0:1789635193.109268:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991168 00000100:00100000:0.0:1789635193.109290:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635193.109303:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421991296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109356:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421991296:12345-0@lo:400:kworker.0 Request processed in 53us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635193.109362:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635193.109374:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635193.109380:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421991168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109408:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421991168:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635193.109414:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635193.109434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991040 00000100:00100000:0.0:1789635193.109438:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991040 00000100:00100000:0.0:1789635193.109472:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421990912 00000100:00100000:0.0:1789635193.109475:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421990912 00000100:00100000:0.0:1789635193.109488:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991424 00000100:00100000:0.0:1789635193.109491:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991424 00000100:00100000:0.0:1789635193.109506:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635193.109512:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568421991040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109548:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568421991040:12345-0@lo:400:kworker.0 Request processed in 36us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635193.109554:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635193.109569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635193.109575:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421990912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109600:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568421990912:12345-0@lo:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635193.109606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789635193.109614:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635193.109618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789635193.109622:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635193.109627:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568421991424:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789635193.109628:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635193.109676:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568421991424:12345-0@lo:400:kworker.0 Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635193.109682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789635193.109724:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7ec9880 x1876568421991168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635193.109739:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421991168:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109750:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568421990784:0@lo:400:kworker.0 00010000:00080000:0.0:1789635193.109759:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7ec9500 x1876568421991296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635193.109767:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421991296:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109800:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568421990912:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109808:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568421991424:0@lo:400:kworker.0 00000100:00100000:0.0:1789635193.109816:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568421991040:0@lo:400:kworker.0 00000100:00100000:2.0:1789635193.111396:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421991552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635193.111460:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635193.111756:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991552 00000100:00100000:1.0:1789635193.111765:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991552 00000100:00100000:1.0:1789635193.111826:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635193.111837:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421991552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635193.111874:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635193.111927:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421991552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635193.111935:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789635193.112071:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb3100 x1876568421991552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635193.112092:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421991552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789635193.878479:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635194.521622:0:8816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789635194.901351:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635195.923577:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635196.691733:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635196.691759:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421991680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635196.691834:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635196.691903:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991680 00000100:00100000:3.0:1789635196.691923:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991680 00000100:00100000:3.0:1789635196.691980:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635196.691989:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421991680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635196.692024:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635196.692069:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421991680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635196.692076:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789635196.692097:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635196.692127:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d6680 x1876568421991680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635196.692156:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421991680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789635196.948437:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635197.470986:0:9060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing yml_node 00000100:00100000:0.0:1789635197.554386:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635197.554564:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410429952 00000100:00100000:2.0:1789635197.554575:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410429952 00000100:00100000:2.0:1789635197.554638:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:2.0:1789635197.554648:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410429952:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635197.556237:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410429952:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1584us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635197.556324:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:1.0:1789635197.557980:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635197.558034:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430208 00000100:00100000:2.0:1789635197.558045:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430208 00000100:00100000:1.0:1789635197.558122:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635197.558153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635197.558176:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430080 00000100:00100000:1.0:1789635197.558181:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430080 00000100:00080000:0.0:1789635197.558488:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635197.558493:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635197.558534:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430336 00000100:00100000:2.0:1789635197.558538:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430336 00000100:00100000:1.0:1789635197.558571:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1789635197.558577:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1789635197.558587:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410430080:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635197.558592:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410430208:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635197.558604:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1789635197.558614:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410430336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635197.558664:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410430208:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635197.558671:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00080000:0.0:1789635197.558678:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635197.558704:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410430080:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 122us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635197.558712:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1789635197.558730:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410430336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 118us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635197.558737:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00010000:00010000:3.0:1789635197.974517:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635198.227543:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635198.227570:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421991808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635198.227648:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635198.227828:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991808 00000100:00100000:3.0:1789635198.227837:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991808 00000100:00100000:3.0:1789635198.227925:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789635198.227936:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421991808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635198.227973:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635198.228013:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421991808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635198.228018:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789635198.228135:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635198.228216:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421991936:0@lo:400:kworker.0 00000100:00100000:0.0:1789635198.228225:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421992320:0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.228255:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.228272:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635198.228289:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421992448:0@lo:400:kworker.0 00000100:00100000:0.0:1789635198.228304:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635198.228329:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568421992192:0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.228350:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.228370:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992320 00000100:00100000:0.0:1789635198.228383:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992320 00000100:00100000:1.0:1789635198.228384:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635198.228392:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421992064:0@lo:400:kworker.0 00000100:00100000:0.0:1789635198.228427:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635198.228437:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421992320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.228438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.228480:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421992320:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.228488:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635198.228499:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421991936 00000100:00100000:1.0:1789635198.228505:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421991936 00000100:00100000:1.0:1789635198.228543:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789635198.228550:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568421991936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.228586:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568421991936:12345-0@lo:400:kworker.0 Request processed in 37us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.228592:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789635198.228620:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992448 00000100:00100000:1.0:1789635198.228624:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992448 00000100:00100000:1.0:1789635198.228648:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992064 00000100:00100000:1.0:1789635198.228651:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992064 00000100:00100000:1.0:1789635198.228670:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789635198.228685:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421992448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.228729:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421992448:12345-0@lo:400:kworker.0 Request processed in 45us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.228735:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789635198.228747:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789635198.228753:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421992064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.228780:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421992064:12345-0@lo:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635198.228786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789635198.228816:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635198.228820:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635198.228829:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635198.228870:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992192 00000100:00100000:0.0:1789635198.228874:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992192 00000100:00100000:0.0:1789635198.228912:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789635198.228919:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568421992192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635198.228947:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568421992192:12345-0@lo:400:kworker.0 Request processed in 28us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635198.228952:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789635198.228965:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635198.229010:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568421992192:0@lo:400:kworker.0 00010000:00080000:1.0:1789635198.229024:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7d92a00 x1876568421992320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635198.229034:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421992320:0@lo:400:kworker.0 00010000:00080000:1.0:1789635198.229069:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d6680 x1876568421991808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635198.229084:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421991808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635198.229107:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421992064:0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.229115:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421991936:0@lo:400:kworker.0 00000100:00100000:1.0:1789635198.229122:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421992448:0@lo:400:kworker.0 00010000:00010000:2.0:1789635198.995607:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635200.022201:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635200.339982:0:9251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789635201.043496:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635201.813089:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421992576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635201.813188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635201.813298:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992576 00000100:00100000:3.0:1789635201.813424:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992576 00000100:00100000:3.0:1789635201.813502:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635201.813514:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421992576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635201.813558:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789635201.813775:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635201.814687:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421992576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1171us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635201.814710:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789635201.814921:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e78c1d45500 x1876568421992576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635201.815147:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421992576:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789635201.821062:0:9349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:3.0:1789635202.067632:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635202.670922:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635202.671034:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635202.671075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635202.671104:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635202.671138:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430848 00000100:00100000:1.0:1789635202.671149:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430848 00000100:00100000:2.0:1789635202.671161:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430720 00000100:00100000:2.0:1789635202.671170:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430720 00000100:00100000:3.0:1789635202.671175:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430464 00000100:00100000:3.0:1789635202.671182:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430464 00000100:00100000:3.0:1789635202.671227:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:1.0:1789635202.671231:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:3.0:1789635202.671242:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2351:x1876568410430464:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635202.671250:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410430848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635202.671351:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410430848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 107us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635202.671395:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789635202.671406:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410430720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635202.671771:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00080000:1.0:1789635202.671797:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635202.671812:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635202.672348:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430592 00000100:00100000:0.0:1789635202.672355:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430592 00000100:00100000:0.0:1789635202.672415:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1789635202.672543:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410430592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635202.673334:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2351:x1876568410430464:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2092us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635202.673346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00080000:3.0:1789635202.673629:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635202.675341:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410430720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3929us (4227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635202.675356:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789635202.675742:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410430592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3318us (4830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635202.675750:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00010000:00010000:1.0:1789635203.091529:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789635203.296606:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:1.0:1789635203.348542:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421992704:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.348625:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.348676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421993216:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.348704:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.348732:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789635203.348739:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568421992832:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.348764:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.348804:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568421993344:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.348828:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.348858:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421992960:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.348879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.348900:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635203.348905:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421993088:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.348927:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635203.348961:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992704 00000100:00100000:1.0:1789635203.348969:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992704 00000100:00100000:1.0:1789635203.349025:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789635203.349035:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421992704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349089:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421992704:12345-0@lo:400:kworker.0 Request processed in 56us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.349097:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789635203.349132:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993216 00000100:00100000:1.0:1789635203.349136:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993216 00000100:00100000:1.0:1789635203.349173:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993088 00000100:00100000:1.0:1789635203.349176:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993088 00000100:00100000:1.0:1789635203.349196:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635203.349203:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421993216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349236:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421993216:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.349242:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635203.349254:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635203.349260:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421993088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349291:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421993088:12345-0@lo:400:kworker.0 Request processed in 32us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.349306:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635203.349342:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992832 00000100:00100000:1.0:1789635203.349347:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992832 00000100:00100000:1.0:1789635203.349372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993344 00000100:00100000:1.0:1789635203.349375:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993344 00000100:00100000:1.0:1789635203.349388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421992960 00000100:00100000:1.0:1789635203.349391:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421992960 00000100:00100000:1.0:1789635203.349406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789635203.349412:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568421992832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349447:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568421992832:12345-0@lo:400:kworker.0 Request processed in 35us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.349452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789635203.349464:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789635203.349471:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568421993344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349496:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568421993344:12345-0@lo:400:kworker.0 Request processed in 27us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.349502:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789635203.349513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789635203.349519:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421992960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349544:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421992960:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635203.349550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789635203.349580:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635203.349586:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635203.349588:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789635203.349619:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe92c380 x1876568421993088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635203.349646:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421993088:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349660:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421992960:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349699:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568421992832:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349708:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568421993344:0@lo:400:kworker.0 00000100:00100000:1.0:1789635203.349716:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421992704:0@lo:400:kworker.0 00010000:00080000:1.0:1789635203.349725:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe92c000 x1876568421993216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635203.349733:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421993216:0@lo:400:kworker.0 00000100:00100000:2.0:1789635203.350001:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635203.350010:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421993472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635203.350041:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635203.350074:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993472 00000100:00100000:2.0:1789635203.350078:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993472 00000100:00100000:2.0:1789635203.350109:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635203.350116:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421993472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635203.350143:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635203.350177:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421993472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635203.350183:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789635203.350208:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dc2c8380 x1876568421993472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635203.350221:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421993472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789635204.117224:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789635204.385399:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 17 04:53:24 EDT 2026 00010000:00010000:0.0:1789635205.140718:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635206.168429:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635206.932646:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635206.932670:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421993600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635206.932757:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635206.932850:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993600 00000100:00100000:0.0:1789635206.932860:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993600 00000100:00100000:0.0:1789635206.932938:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789635206.932963:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421993600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635206.933004:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635206.933071:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421993600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635206.933079:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789635206.933113:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e78c1d47480 x1876568421993600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635206.933147:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421993600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789635206.933210:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635207.188593:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635207.792770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635207.792867:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635207.794675:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410430976 00000100:00100000:2.0:1789635207.794693:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410430976 00000100:00100000:2.0:1789635207.794776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:2.0:1789635207.794789:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2350:x1876568410430976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635207.794883:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2350:x1876568410430976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 96us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635207.794890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:3.0:1789635207.797773:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410431104 00000100:00100000:3.0:1789635207.797790:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410431104 00000100:00080000:0.0:1789635207.797860:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635207.797886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1789635207.797900:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410431104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635207.800279:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410431104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2367us (7507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635207.800297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1789635207.802692:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635207.803000:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410431232 00000100:00100000:0.0:1789635207.803014:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410431232 00000100:00100000:0.0:1789635207.803090:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789635207.803103:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2347:x1876568410431232:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1789635207.803147:0:8106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2cd2 00000100:00080000:0.0:1789635207.803158:0:8106:0:(import.c:65:import_set_state_nolock()) ffff9e79cdff6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635207.803202:0:8106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789635207.803673:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+2:2347:x1876568410431232:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 570us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635207.803682:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00080000:0.0:1789635207.803751:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635207.803860:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635207.803940:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410431360 00000100:00100000:0.0:1789635207.803945:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410431360 00000100:00100000:0.0:1789635207.805988:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789635207.806008:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2347:x1876568410431360:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1789635207.806044:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2cd9 00000100:00080000:0.0:1789635207.806058:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fe800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635207.806097:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789635207.806489:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+2:2347:x1876568410431360:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 487us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635207.806497:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00010000:00010000:0.0:1789635207.806544:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635207.806974:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789635207.808588:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789635208.211565:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635208.469470:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421993728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635208.469550:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635208.469603:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421994240:0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.469629:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635208.469656:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789635208.469663:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421993856:0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.469691:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635208.469724:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421994368:0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.469743:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635208.469824:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421993984:0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.469852:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635208.469876:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421994496:0@lo:400:kworker.0 00000100:00100000:2.0:1789635208.469898:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993984 00000100:00100000:1.0:1789635208.469900:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635208.469909:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993984 00000100:00100000:1.0:1789635208.469924:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635208.469931:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421994112:0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.469955:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635208.469969:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421994496 00000100:00100000:2.0:1789635208.469974:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421994496 00000100:00100000:1.0:1789635208.469996:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993728 00000100:00100000:1.0:1789635208.470002:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993728 00000100:00100000:2.0:1789635208.470003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421994112 00000100:00100000:2.0:1789635208.470008:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421994112 00000100:00100000:2.0:1789635208.470037:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789635208.470044:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789635208.470050:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421993984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.470058:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421993728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635208.470092:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635208.470137:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421993728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635208.470144:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635208.470167:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421994240 00000100:00100000:1.0:1789635208.470170:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421994240 00000100:00100000:1.0:1789635208.470195:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421994368 00000100:00100000:1.0:1789635208.470198:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421994368 00000100:00100000:1.0:1789635208.470217:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635208.470224:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421994240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.470255:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421994240:12345-0@lo:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635208.470262:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635208.470273:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789635208.470278:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421993984:12345-0@lo:400:kworker.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635208.470280:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421994368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635208.470294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789635208.470337:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421994368:12345-0@lo:400:kworker.0 Request processed in 57us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635208.470345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789635208.470352:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789635208.470368:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421994496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.470380:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421993856 00000100:00100000:1.0:1789635208.470385:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421993856 00000100:00100000:2.0:1789635208.470408:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421994496:12345-0@lo:400:kworker.0 Request processed in 44us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635208.470416:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789635208.470423:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789635208.470432:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421993856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635208.470436:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635208.470447:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421994112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635208.470468:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421993856:12345-0@lo:400:kworker.0 Request processed in 38us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635208.470475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789635208.470530:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421993856:0@lo:400:kworker.0 00010000:00080000:1.0:1789635208.470544:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe92ea00 x1876568421994368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635208.470555:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421994368:0@lo:400:kworker.0 00010000:00080000:1.0:1789635208.470565:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dc2ca300 x1876568421993728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635208.470579:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421993728:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789635208.470589:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe92fb80 x1876568421994240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635208.470597:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421994240:0@lo:400:kworker.0 00000100:00100000:2.0:1789635208.470643:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421994112:12345-0@lo:400:kworker.0 Request processed in 198us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635208.470650:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789635208.470676:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635208.470681:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635208.470685:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635208.470743:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421994112:0@lo:400:kworker.0 00000100:00100000:2.0:1789635208.470754:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421993984:0@lo:400:kworker.0 00000100:00100000:2.0:1789635208.470763:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421994496:0@lo:400:kworker.0 00010000:00010000:0.0:1789635209.236463:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789635209.510744:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:0.0:1789635209.510755:0:6717:0:(genops.c:885:class_export_put()) final put ffff9e79cdff1000/e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:0.0:1789635209.510781:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79cdff1000/e05ee327-d920-4885-acb2-a26d789e134c for lustre-OST0000 00000020:00000080:0.0:1789635209.510823:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79cdff6800 for lustre-OST0000 00010000:00010000:0.0:1789635210.259427:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789635211.065637:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:1.0:1789635211.065646:0:7663:0:(genops.c:885:class_export_put()) final put ffff9e79dc2f8000/e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:1.0:1789635211.065689:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79dc2f8000/e05ee327-d920-4885-acb2-a26d789e134c for lustre-OST0001 00000020:00000080:1.0:1789635211.065732:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79dc2fe800 for lustre-OST0001 00010000:00010000:1.0:1789635211.286130:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635212.052086:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421994624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635212.052172:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635212.052347:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421994624 00000100:00100000:0.0:1789635212.052356:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421994624 00000100:00100000:0.0:1789635212.052432:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635212.052444:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421994624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635212.052483:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635212.052545:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421994624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635212.052552:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789635212.052699:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e78c1d47800 x1876568421994624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635212.052706:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635212.052725:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421994624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789635212.307546:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635212.844264:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:53:33 (1789635213) === 00000100:00100000:2.0:1789635212.912395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635212.912481:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635212.912528:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410431616 00000100:00100000:1.0:1789635212.912539:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410431616 00000100:00100000:3.0:1789635212.912547:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410431488 00000100:00100000:3.0:1789635212.912551:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410431488 00000100:00100000:3.0:1789635212.912600:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:1.0:1789635212.912600:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789635212.912610:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410431488:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635212.912610:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410431616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1789635212.912643:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635212.912704:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410431616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635212.912713:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789635212.912726:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410431488:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635212.912733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:2.0:1789635213.141564:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635213.141801:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410431744 00000100:00100000:1.0:1789635213.141815:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410431744 00000100:00100000:1.0:1789635213.141883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:1.0:1789635213.141894:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:8110:x1876568410431744:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789635213.141924:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635213.141947:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2dab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cfa6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635213.142061:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfa6 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635213.142078:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfa6 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635213.142087:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85600, rc 0) 00000100:00100000:1.0:1789635213.142161:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8110:x1876568410431744:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 269us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.142187:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:2.0:1789635213.144250:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635213.144363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410431872 00000100:00100000:3.0:1789635213.144373:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410431872 00000100:00100000:3.0:1789635213.144437:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:3.0:1789635213.144448:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8110:x1876568410431872:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789635213.144802:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8110:x1876568410431872:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 355us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635213.144813:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:2.0:1789635213.146202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635213.146289:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432000 00000100:00100000:0.0:1789635213.146305:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432000 00000100:00100000:0.0:1789635213.146402:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:0.0:1789635213.146413:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8110:x1876568410432000:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789635213.146708:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8110:x1876568410432000:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 295us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.146715:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:2.0:1789635213.150552:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635213.150717:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432128 00000100:00100000:0.0:1789635213.150729:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432128 00000100:00100000:0.0:1789635213.150843:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:0.0:1789635213.150855:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8114:x1876568410432128:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635213.151200:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8114:x1876568410432128:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 346us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.151215:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:2.0:1789635213.168971:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635213.169095:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432256 00000100:00100000:0.0:1789635213.169109:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432256 00000100:00100000:0.0:1789635213.169173:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:0.0:1789635213.169199:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8114:x1876568410432256:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635213.169901:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8114:x1876568410432256:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 716us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.169913:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:2.0:1789635213.174781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635213.174865:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432384 00000100:00100000:3.0:1789635213.174878:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432384 00000100:00100000:3.0:1789635213.174939:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:3.0:1789635213.174948:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:8110:x1876568410432384:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789635213.174972:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635213.174994:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1677200/0x77332204cfbb2db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cfd0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635213.175027:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1677200/0x77332204cfbb2db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635213.175035:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1677200/0x77332204cfbb2db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635213.175068:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1677200, rc 0) 00000100:00100000:3.0:1789635213.175130:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:8110:x1876568410432384:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 183us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635213.175136:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:0.0:1789635213.178529:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635213.179586:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432512 00000100:00100000:1.0:1789635213.179599:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432512 00000100:00100000:1.0:1789635213.179699:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:1.0:1789635213.179712:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:8110:x1876568410432512:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789635213.179748:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789635213.179779:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789635213.179783:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789635213.179787:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789635213.179789:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789635213.182468:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:8110:x1876568410432512:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 2742us (3935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.182484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:2.0:1789635213.186630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635213.187973:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432640 00000100:00100000:0.0:1789635213.187990:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432640 00000100:00100000:0.0:1789635213.188119:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:0.0:1789635213.188131:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:8110:x1876568410432640:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635213.188158:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635213.188181:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632cfd7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635213.188217:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635213.188557:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635213.188568:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031c00, rc 0) 00000100:00100000:0.0:1789635213.188685:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8110:x1876568410432640:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 555us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.188716:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:0.0:1789635213.192124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635213.192528:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432768 00000100:00100000:2.0:1789635213.192555:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432768 00000100:00100000:2.0:1789635213.192632:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:2.0:1789635213.192645:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8110:x1876568410432768:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789635213.193017:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8110:x1876568410432768:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 373us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.193025:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:2.0:1789635213.195296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635213.195442:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410432896 00000100:00100000:3.0:1789635213.195455:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410432896 00000100:00100000:3.0:1789635213.195505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:3.0:1789635213.195516:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8110:x1876568410432896:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789635213.195813:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8110:x1876568410432896:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 297us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635213.195822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:0.0:1789635213.203177:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635213.203296:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433024 00000100:00100000:2.0:1789635213.203388:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433024 00000100:00100000:2.0:1789635213.203462:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:2.0:1789635213.203474:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8117:x1876568410433024:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635213.203802:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8117:x1876568410433024:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 329us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.203811:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:2.0:1789635213.208003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635213.208096:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433152 00000100:00100000:3.0:1789635213.208115:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433152 00000100:00100000:3.0:1789635213.208179:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:3.0:1789635213.208190:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8117:x1876568410433152:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635213.209468:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:8117:x1876568410433152:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 1276us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.209478:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:2.0:1789635213.212447:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635213.212943:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433280 00000100:00100000:1.0:1789635213.212956:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433280 00000100:00100000:1.0:1789635213.213060:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1789635213.213071:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1876568410433280:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789635213.213110:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83@192.168.201.30@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1789635213.213161:0:5842:0:(genops.c:1384:class_connect()) connect: client 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83, cookie 0x77332204cfbb2dc0 00000004:00100000:1.0:1789635213.213199:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789635213.213557:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9e79c7343000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635213.213645:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:2347:x1876568410433280:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 574us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.213654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789635213.215839:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635213.215880:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635213.215964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433408 00000100:00100000:2.0:1789635213.215974:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433408 00000100:00100000:2.0:1789635213.216051:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433536 00000100:00100000:2.0:1789635213.216056:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433536 00000100:00100000:2.0:1789635213.216078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789635213.216087:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+7:0:x1876568410433408:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789635213.216159:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789635213.216266:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+7:0:x1876568410433408:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 180us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.216274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789635213.216292:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1789635213.216300:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:8110:x1876568410433536:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789635213.216338:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789635213.216360:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:8110:x1876568410433536:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 62us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.216367:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00080000:3.0:1789635213.216876:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635213.218445:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635213.218638:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433664 00000100:00100000:2.0:1789635213.218649:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433664 00000100:00100000:2.0:1789635213.218711:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1789635213.218722:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:8110:x1876568410433664:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789635213.218823:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:8110:x1876568410433664:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 102us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.218830:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1789635213.228192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635213.228254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635213.228305:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635213.228463:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433792 00000100:00100000:0.0:1789635213.228477:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433792 00000100:00100000:0.0:1789635213.228529:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410433920 00000100:00100000:0.0:1789635213.228532:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410433920 00000100:00100000:0.0:1789635213.228556:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789635213.228567:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876568410433792:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789635213.228620:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83@192.168.201.30@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1789635213.228665:0:6693:0:(genops.c:1384:class_connect()) connect: client 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83, cookie 0x77332204cfbb2dc7 00002000:00100000:0.0:1789635213.228680:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83/ffff9e79fe5f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635213.228709:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635213.228956:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789635213.228991:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5f7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635213.229069:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:2347:x1876568410433792:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 502us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.229076:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789635213.229096:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789635213.229100:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876568410433920:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789635213.229116:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83@192.168.201.30@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1789635213.229151:0:6693:0:(genops.c:1384:class_connect()) connect: client 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83, cookie 0x77332204cfbb2dce 00002000:00100000:0.0:1789635213.229156:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83/ffff9e79fe5f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635213.229171:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635213.229294:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789635213.229308:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5f1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635213.229360:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:2347:x1876568410433920:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 257us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.229367:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1789635213.229945:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434048 00000100:00100000:3.0:1789635213.229955:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434048 00000100:00100000:3.0:1789635213.230004:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1789635213.230013:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:8110:x1876568410434048:12345-192.168.201.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789635213.230083:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789635213.230148:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:8110:x1876568410434048:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 137us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635213.230155:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00010000:0.0:1789635213.331518:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635213.587545:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421995008:0@lo:400:kworker.0 00000100:00100000:3.0:1789635213.587557:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421994880:0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.587651:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421994752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635213.587776:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568421995136:0@lo:400:kworker.0 00000100:00100000:3.0:1789635213.588770:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635213.588836:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421995264:0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.588845:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635213.588866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635213.588879:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421995392:0@lo:400:kworker.0 00000100:00100000:3.0:1789635213.588881:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635213.588912:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635213.588916:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421995520:0@lo:400:kworker.0 00000100:00100000:2.0:1789635213.588952:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635213.588955:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421994880 00000100:00100000:1.0:1789635213.588962:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421994752 00000100:00100000:3.0:1789635213.588964:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421994880 00000100:00100000:1.0:1789635213.588969:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421994752 00000100:00100000:2.0:1789635213.589009:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995008 00000100:00100000:2.0:1789635213.589015:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995008 00000100:00100000:3.0:1789635213.589021:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789635213.589034:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635213.589037:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421994880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.589048:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421994752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635213.589071:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635213.589111:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421994880:12345-0@lo:400:kworker.0 Request processed in 78us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635213.589119:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789635213.589125:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421994752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.589134:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635213.589163:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995264 00000100:00080000:3.0:1789635213.589167:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635213.589168:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995264 00000100:00100000:3.0:1789635213.589200:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421994880:0@lo:400:kworker.0 00000100:00100000:2.0:1789635213.589223:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995520 00000100:00100000:2.0:1789635213.589229:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995520 00000100:00100000:0.0:1789635213.589245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635213.589372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995136 00000100:00100000:0.0:1789635213.589375:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995136 00000100:00100000:1.0:1789635213.591399:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995392 00000100:00100000:1.0:1789635213.591412:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995392 00000100:00100000:1.0:1789635213.591473:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635213.591485:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421995264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.591576:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421995264:12345-0@lo:400:kworker.0 Request processed in 94us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.591584:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789635213.591613:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635213.591620:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421995392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.591990:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568421995392:12345-0@lo:400:kworker.0 Request processed in 370us (3077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.591997:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789635213.592061:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79c7a0d500 x1876568421994752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635213.592116:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421994752:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789635213.592132:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe92c000 x1876568421995392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635213.592142:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568421995392:0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.592274:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789635213.592284:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421995008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.592552:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568421995008:12345-0@lo:400:kworker.0 Request processed in 270us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635213.592560:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789635213.592601:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe92ea00 x1876568421995264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635213.592625:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421995264:0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.592944:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568421995008:0@lo:400:kworker.0 00000100:00080000:3.0:1789635213.595260:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635213.595358:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635213.595598:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789635213.595622:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568421995136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635213.595959:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568421995136:12345-0@lo:400:kworker.0 Request processed in 341us (6719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635213.595967:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635213.596024:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421995520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635213.596288:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568421995520:12345-0@lo:400:kworker.0 Request processed in 919us (7336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635213.596296:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789635213.596420:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568421995136:0@lo:400:kworker.0 00000100:00100000:1.0:1789635213.596505:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568421995520:0@lo:400:kworker.0 00010000:00010000:0.0:1789635214.355996:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789635214.643247:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00010000:00010000:1.0:1789635215.379814:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789635216.182998:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00000001:02000400:1.0:1789635216.312753:0:10321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789635216.413064:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635217.172705:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635217.172729:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421995648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635217.172798:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635217.172854:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995648 00000100:00100000:0.0:1789635217.172862:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995648 00000100:00100000:0.0:1789635217.172911:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789635217.172919:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421995648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635217.172959:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635217.172999:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421995648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635217.173006:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789635217.173025:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789635217.173053:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e78c1d44700 x1876568421995648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635217.173070:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421995648:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789635217.207733:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00010000:00010000:1.0:1789635217.427571:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635218.452409:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635218.544560:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635218.544609:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635218.544652:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635218.544679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635218.544707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635218.544738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434176 00000100:00100000:3.0:1789635218.544756:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434176 00000100:00100000:3.0:1789635218.544808:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:3.0:1789635218.544819:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410434176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635218.544891:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410434176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635218.544899:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:3.0:1789635218.544930:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434560 00000100:00100000:3.0:1789635218.544933:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434560 00000100:00100000:2.0:1789635218.544962:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434688 00000100:00100000:2.0:1789635218.544969:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434688 00000100:00100000:2.0:1789635218.545011:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:2.0:1789635218.545017:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410434688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635218.545044:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410434688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635218.545049:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00080000:2.0:1789635218.545063:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635218.545104:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434304 00000100:00100000:1.0:1789635218.545109:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434304 00000100:00100000:1.0:1789635218.545296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434432 00000100:00100000:1.0:1789635218.545300:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434432 00000100:00100000:1.0:1789635218.545344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789635218.545353:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1789635218.545355:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410434304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635218.545363:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410434432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635218.545395:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410434304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635218.545396:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410434432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635218.545406:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1789635218.545420:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00080000:2.0:1789635218.545423:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635218.545596:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00080000:2.0:1789635218.545597:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635218.545607:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410434560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635218.545637:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410434560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635218.545644:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1789635218.707568:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421995776:0@lo:400:kworker.0 00000100:00100000:0.0:1789635218.707569:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568421995904:0@lo:400:kworker.0 00000100:00100000:1.0:1789635218.707593:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421996032:0@lo:400:kworker.0 00000100:00100000:0.0:1789635218.707650:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635218.707714:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995904 00000100:00100000:2.0:1789635218.707722:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995904 00000100:00100000:2.0:1789635218.707789:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789635218.707800:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568421995904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.707859:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635218.707917:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421996288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.707947:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635218.707967:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635218.707972:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568421996416:0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.707999:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421996160:0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.708021:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635218.708038:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635218.708043:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421996544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635218.708065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635218.708090:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421995776 00000100:00100000:3.0:1789635218.708100:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421995776 00000100:00100000:3.0:1789635218.708128:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789635218.708134:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421995776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.708167:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421995776:12345-0@lo:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635218.708174:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789635218.708205:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996288 00000100:00100000:3.0:1789635218.708208:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996288 00000100:00100000:3.0:1789635218.708237:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996160 00000100:00100000:3.0:1789635218.708240:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996160 00000100:00100000:3.0:1789635218.708258:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635218.708265:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421996288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.708293:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421996288:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635218.708299:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789635218.708690:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635218.708701:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421996160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635218.708732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635218.708752:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421996160:12345-0@lo:400:kworker.0 Request processed in 52us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635218.708759:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635218.708786:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996544 00000100:00100000:1.0:1789635218.708790:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996544 00000100:00100000:1.0:1789635218.708816:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789635218.708823:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421996544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635218.708852:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635218.708885:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421996544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635218.708892:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789635218.708929:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79c7a0fb80 x1876568421996544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635218.708948:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421996544:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789635218.708959:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e717b100 x1876568421996160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635218.708968:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421996160:0@lo:400:kworker.0 00000100:00100000:0.0:1789635218.709013:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996032 00000100:00100000:0.0:1789635218.709019:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996032 00000100:00080000:3.0:1789635218.709028:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635218.709035:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635218.709060:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635218.709070:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421996032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635218.709125:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421996032:12345-0@lo:400:kworker.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635218.709133:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789635218.709347:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421996032:0@lo:400:kworker.0 00000100:00100000:2.0:1789635218.711797:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568421995904:12345-0@lo:400:kworker.0 Request processed in 3991us (4138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635218.711811:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635218.711959:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568421995904:0@lo:400:kworker.0 00000100:00100000:1.0:1789635218.712045:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789635218.712103:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e717a680 x1876568421996288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635218.712115:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421996288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.712120:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996416 00000100:00100000:3.0:1789635218.712131:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996416 00000100:00100000:3.0:1789635218.712307:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789635218.712340:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568421996416:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789635218.712343:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635218.712393:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568421996416:12345-0@lo:400:kworker.0 Request processed in 58us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635218.712395:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421995776:0@lo:400:kworker.0 00000100:00100000:3.0:1789635218.712407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635218.712431:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568421996416:0@lo:400:kworker.0 00010000:00010000:1.0:1789635219.476240:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635220.500472:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635221.524513:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635222.291503:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421996672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635222.291570:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635222.291697:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996672 00000100:00100000:3.0:1789635222.291708:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996672 00000100:00100000:3.0:1789635222.291778:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789635222.291789:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421996672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635222.291826:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789635222.291850:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635222.291879:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568421996672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635222.291886:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789635222.292695:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe92d500 x1876568421996672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635222.292718:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568421996672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789635222.547518:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635223.571513:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635223.663407:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635223.663458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635223.663484:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635223.663626:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434816 00000100:00100000:3.0:1789635223.663648:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434816 00000100:00100000:3.0:1789635223.663700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:3.0:1789635223.663711:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410434816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635223.663804:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410434816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635223.663812:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:0.0:1789635223.665142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635223.665203:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635223.665228:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410434944 00000100:00100000:0.0:1789635223.665292:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410434944 00000100:00100000:0.0:1789635223.665362:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435072 00000100:00100000:0.0:1789635223.665366:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435072 00000100:00100000:0.0:1789635223.665389:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1789635223.665399:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410434944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635223.665464:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410434944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 66us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635223.665472:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1789635223.665488:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1789635223.665494:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410435072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635223.665519:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410435072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635223.665627:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435200 00000100:00100000:3.0:1789635223.665632:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435200 00000100:00100000:3.0:1789635223.665917:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435328 00000100:00100000:3.0:1789635223.665921:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435328 00000100:00100000:3.0:1789635223.665943:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1789635223.665964:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410435200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635223.665988:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410435200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635223.665994:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1789635223.666007:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789635223.666013:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410435328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635223.666034:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410435328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635223.666039:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:0.0:1789635223.667533:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00080000:0.0:1789635223.667564:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635223.667568:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635223.667572:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635223.827661:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421996800:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.827724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635223.827766:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421997312:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.827784:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635223.827803:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789635223.827807:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568421996928:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.827821:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635223.827832:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568421997440:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.827844:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635223.827847:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996800 00000100:00100000:3.0:1789635223.827858:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996800 00000100:00100000:1.0:1789635223.827866:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421997056:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.827885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635223.827901:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635223.827909:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421997184:0@lo:400:kworker.0 00000100:00100000:3.0:1789635223.827914:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789635223.827928:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421996800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.827936:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635223.827973:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421997312 00000100:00100000:1.0:1789635223.827977:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421997312 00000100:00100000:3.0:1789635223.827997:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421996800:12345-0@lo:400:kworker.0 Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635223.828005:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789635223.828019:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421997184 00000100:00100000:1.0:1789635223.828024:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421997184 00000100:00100000:1.0:1789635223.828052:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635223.828064:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789635223.828065:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421997312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635223.828077:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421997184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.828110:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568421997312:12345-0@lo:400:kworker.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635223.828118:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635223.828126:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421997184:12345-0@lo:400:kworker.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635223.828524:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421996928 00000100:00100000:1.0:1789635223.828529:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421996928 00000100:00100000:1.0:1789635223.828558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421997440 00000100:00100000:1.0:1789635223.828569:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421997440 00000100:00100000:1.0:1789635223.828589:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421997056 00000100:00100000:1.0:1789635223.828591:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421997056 00000100:00100000:1.0:1789635223.828607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789635223.828614:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568421996928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.828655:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568421996928:12345-0@lo:400:kworker.0 Request processed in 41us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635223.828663:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789635223.828679:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789635223.828686:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568421997440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.828717:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568421997440:12345-0@lo:400:kworker.0 Request processed in 32us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635223.828723:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789635223.828739:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789635223.828745:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.828772:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568421997056:12345-0@lo:400:kworker.0 Request processed in 27us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635223.828777:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789635223.828806:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635223.828811:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635223.828827:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421997568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635223.828854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789635223.828888:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e717bb80 x1876568421997184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635223.828901:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421997184:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.828913:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568421997056:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.828945:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421997568 00000100:00100000:1.0:1789635223.828948:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421997568 00000100:00100000:1.0:1789635223.828971:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635223.828978:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421997568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635223.829004:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635223.829050:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421997568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635223.829055:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635223.829083:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568421996928:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.829092:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568421997440:0@lo:400:kworker.0 00000100:00100000:1.0:1789635223.829100:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421996800:0@lo:400:kworker.0 00010000:00080000:1.0:1789635223.829108:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e717aa00 x1876568421997312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635223.829118:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568421997312:0@lo:400:kworker.0 00010000:00080000:1.0:1789635223.829142:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79c7a0df80 x1876568421997568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635223.829155:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421997568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635223.831091:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789635224.602633:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635225.409948:0:11022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789635225.619600:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635226.644394:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789635227.302974:0:11170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8950b3b0 20000000:00000080:2.0:1789635227.303000:0:11170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e79e7b73c00 uarg=0000000000000000 20000000:01000000:2.0:1789635227.303052:0:11170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635227.303060:0:11170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635227.303065:0:11170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789635227.304229:0:11171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789635227.304367:0:11170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789635227.310183:0:11170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789635227.310225:0:11170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310248:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310283:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310291:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310302:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310338:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310347:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310419:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310438:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 12 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635227.310456:0:11170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421997696:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635227.310597:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310606:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 12 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635227.310615:0:11170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421997824:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635227.310655:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310664:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 18 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635227.310674:0:11170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421997952:0@lo:104: 00000100:00100000:0.0:1789635227.310724:0:11170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635227.310785:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.310795:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 18 pid: 7647 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635227.310803:0:11170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421998080:0@lo:104: 00000100:00100000:0.0:1789635227.310825:0:11170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.310871:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421997952 00000100:00100000:0.0:1789635227.310882:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421997952 00000100:00100000:0.0:1789635227.310927:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998080 00000100:00100000:0.0:1789635227.310930:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998080 00000100:00100000:0.0:1789635227.310947:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635227.310957:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:11170:x1876568421997952:12345-0@lo:104: 00010000:00010000:0.0:1789635227.310972:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311027:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635227.311034:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:11170:x1876568421997952:12345-0@lo:104: Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635227.311042:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635227.311071:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635227.311078:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:11170:x1876568421998080:12345-0@lo:104: 00010000:00010000:0.0:1789635227.311085:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311120:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789635227.311125:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:11170:x1876568421998080:12345-0@lo:104: Request processed in 48us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635227.311131:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789635227.311150:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635227.311156:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311163:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635227.311166:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311174:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635227.311181:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635227.311186:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789635227.311211:0:7642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311218:0:7642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635227.311236:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311254:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85e00/0x77332204cfbb2d96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311270:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635227.311273:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311279:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030000 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635227.311283:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311289:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635227.311295:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635227.311301:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789635227.311377:0:7642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311384:0:7642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635227.311397:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311404:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c0030000/0x77332204cfbb2d88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311414:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635227.311421:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635227.311423:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635227.311442:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311451:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 18 pid: 5836 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635227.311459:0:11170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421998464:0@lo:104: 00000100:00100000:0.0:1789635227.311482:0:11170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.311500:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998464 00000100:00100000:0.0:1789635227.311503:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998464 00000100:00100000:0.0:1789635227.311519:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789635227.311524:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:11170:x1876568421998464:12345-0@lo:104: 00010000:00010000:0.0:1789635227.311532:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.311558:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635227.311563:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:11170:x1876568421998464:12345-0@lo:104: Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635227.311569:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789635227.311588:0:11170:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635227.311614:0:11170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421997952:0@lo:104: 00000100:00100000:0.0:1789635227.311622:0:11170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421998080:0@lo:104: 00000100:00100000:0.0:1789635227.311627:0:11170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421998464:0@lo:104: 00010000:00010000:1.0:1789635227.311959:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635227.311966:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.311973:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635227.311977:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.311992:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635227.312000:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635227.312005:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635227.312023:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312030:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635227.312038:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312046:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb2d7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2d81 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312061:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635227.312063:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635227.312065:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635227.312076:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635227.312087:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421998208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635227.312124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.312182:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421998336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635227.312209:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635227.312228:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635227.312233:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421998592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635227.312253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635227.312286:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635227.312298:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998208 00000100:00100000:1.0:1789635227.312302:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998208 00010000:00010000:1.0:1789635227.312354:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 19 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635227.312388:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998336 00000100:00100000:1.0:1789635227.312391:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998336 00010000:00010000:1.0:1789635227.312404:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 20 pid: 7647 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635227.312415:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998592 00000100:00100000:1.0:1789635227.312418:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998592 00010000:00010000:1.0:1789635227.312428:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 21 pid: 5836 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635227.312440:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789635227.312446:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7179f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+21:3306:x1876568421998208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635227.312458:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635227.312464:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 21 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312473:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 21 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312486:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b84600/0x77332204cfbb2d9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2d96 expref: 21 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312500:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635227.312525:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7179f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3306:x1876568421998208:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.312540:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789635227.312554:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789635227.312559:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568421998336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635227.312567:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635227.312571:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 19 pid: 7647 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312579:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 19 pid: 7647 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312588:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821000/0x77332204cfbb2d8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2d88 expref: 19 pid: 7647 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312596:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635227.312616:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3308:x1876568421998336:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.312622:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789635227.312661:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635227.312667:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:3308:x1876568421998592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635227.312673:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635227.312678:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 17 pid: 5836 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312685:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 17 pid: 5836 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312694:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe820400/0x77332204cfbb2d81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2d7a expref: 17 pid: 5836 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.312713:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635227.312733:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3308:x1876568421998592:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635227.312740:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635227.312774:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568421998208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635227.312796:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421998592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635227.312803:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568421998336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635227.315682:0:11170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421997696:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635227.315700:0:11170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1876568421997824:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635227.315745:0:11170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635227.319153:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635227.319263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635227.319414:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435456 00000100:00100000:1.0:1789635227.319426:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435456 00010000:00010000:1.0:1789635227.319477:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 13 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635227.319514:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435584 00000100:00100000:1.0:1789635227.319517:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435584 00010000:00010000:1.0:1789635227.319531:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 14 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635227.319562:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:1.0:1789635227.319573:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+14:2349:x1876568410435456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635227.319591:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635227.319599:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 14 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.319613:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 14 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.319659:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2db9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd7 expref: 14 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635227.319681:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635227.319683:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789635227.319698:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410435584:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635227.319719:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635227.319725:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 13 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319737:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 13 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635227.319749:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410435456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 175us (609us total) trans 0 rc 0/0 00010000:00010000:3.0:1789635227.319750:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe820600/0x77332204cfbb2da4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf9f expref: 13 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635227.319766:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00010000:00010000:3.0:1789635227.319780:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319791:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319811:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319819:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319828:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319836:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319843:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635227.319848:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319868:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319885:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635227.319898:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635227.319949:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:2349:x1876568410435584:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 254us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635227.319957:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00010000:00010000:0.0:1789635227.320282:0:11170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.320292:0:11170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635227.320298:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0030400/0x77332204cfbb2dd5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635227.411632:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421998720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635227.411788:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635227.411921:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998720 00000100:00100000:0.0:1789635227.411932:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998720 00000100:00080000:0.0:1789635227.412175:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635227.412195:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635227.412208:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421998720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635227.412284:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635227.412392:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568421998720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635227.412400:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789635227.412895:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79c7a0c700 x1876568421998720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635227.412922:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568421998720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789635227.667526:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789635228.371994:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635228.372004:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fe5fc000 from 7 10000000:01000000:1.0:1789635228.372008:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635228.372056:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.372068:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.372079:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635228.372106:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421998848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635228.372177:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635228.372215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998848 00000100:00100000:1.0:1789635228.372229:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.372236:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998848 00000100:00100000:3.0:1789635228.372292:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789635228.372302:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568421998848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635228.372330:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635228.372355:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2ddc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635228.372378:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635228.372388:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635228.372398:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1677a00, rc 0) 00000100:00100000:3.0:1789635228.372435:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421998848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.372443:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789635228.373034:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421998848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635228.373050:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.373060:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635228.373126:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421998976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635228.373152:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635228.373175:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.373187:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421998976 00000100:00100000:3.0:1789635228.373192:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421998976 00000100:00100000:3.0:1789635228.373222:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789635228.373230:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421998976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.373489:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421998976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.373497:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789635228.373527:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421998976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.373552:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.373588:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635228.373602:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c96ef240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.373614:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421999104 00000100:00100000:3.0:1789635228.373617:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421999104 00000100:00100000:3.0:1789635228.373638:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789635228.373644:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421999104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.373788:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421999104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.373796:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789635228.373831:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789635228.374988:0:11253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789635228.379077:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789635228.379110:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635228.379121:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.379135:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635228.379156:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635228.379159:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fb977800 from 7 10000000:01000000:0.0:1789635228.379161:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635228.379197:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.379204:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.379214:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635228.379237:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635228.379302:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635228.379387:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421999232 00000100:00100000:0.0:1789635228.379389:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.379395:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421999232 00000100:00100000:3.0:1789635228.379455:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789635228.379466:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568421999232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635228.379480:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635228.379500:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2dea expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635228.379538:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2dea expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635228.379557:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2dea expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635228.379572:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676000, rc 0) 00000100:00100000:3.0:1789635228.379648:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421999232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.379655:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789635228.379739:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635228.379754:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.379763:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635228.379815:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635228.379841:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635228.379861:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.379889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421999360 00000100:00100000:3.0:1789635228.379899:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421999360 00000100:00100000:3.0:1789635228.379940:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789635228.379947:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421999360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.380553:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421999360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 597us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.380568:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789635228.380701:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635228.380730:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635228.380775:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635228.380802:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.380821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421999488 00000100:00100000:3.0:1789635228.380826:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421999488 00000100:00100000:3.0:1789635228.380871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789635228.380885:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421999488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.381165:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421999488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.381173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789635228.381363:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789635228.383474:0:11254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789635228.383551:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789635228.383571:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635228.383594:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.383606:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635228.383617:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635228.383620:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79c8241800 from 7 10000000:01000000:1.0:1789635228.383622:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635228.383656:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.383665:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.383675:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635228.383698:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635228.383759:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635228.383802:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635228.383812:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421999616 00000100:00100000:0.0:1789635228.383820:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421999616 00000100:00100000:0.0:1789635228.383960:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789635228.383972:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568421999616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635228.383987:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635228.384001:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2df8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.384023:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.384034:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.384042:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030e00, rc 0) 00000100:00100000:0.0:1789635228.384082:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421999616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635228.384089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789635228.384148:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635228.384169:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.384177:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635228.384217:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635228.384238:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635228.384257:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.384353:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421999744 00000100:00100000:3.0:1789635228.384363:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421999744 00000100:00100000:3.0:1789635228.384389:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789635228.384394:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421999744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.384618:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421999744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.384625:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789635228.384655:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.384681:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.384716:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635228.384730:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c9ad5480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635228.384740:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568421999872 00000100:00100000:3.0:1789635228.384744:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568421999872 00000100:00100000:3.0:1789635228.384761:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789635228.384767:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421999872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635228.384895:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568421999872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.384901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789635228.384938:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568421999872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789635228.385884:0:11255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789635228.386354:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789635228.386373:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789635228.386383:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635228.386394:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635228.691422:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635228.782566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635228.782611:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635228.782643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635228.782660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435840 00000100:00100000:1.0:1789635228.782672:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635228.782679:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435840 00000100:00100000:1.0:1789635228.782720:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635228.782761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435712 00000100:00100000:1.0:1789635228.782771:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435712 00000100:00100000:3.0:1789635228.782772:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410435968 00000100:00100000:3.0:1789635228.782778:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410435968 00000100:00100000:3.0:1789635228.782825:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1789635228.782840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:1.0:1789635228.782852:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:2351:x1876568410435712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635228.782936:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:2351:x1876568410435712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635228.782943:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:3.0:1789635228.782955:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410435840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635228.782983:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436096 00000100:00100000:1.0:1789635228.782989:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436096 00000100:00100000:1.0:1789635228.783035:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436224 00000100:00100000:1.0:1789635228.783038:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436224 00000100:00100000:1.0:1789635228.783061:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1789635228.783069:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2350:x1876568410436096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635228.783111:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410435840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 272us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.783129:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1789635228.783130:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2350:x1876568410436096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 53us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635228.783143:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1789635228.783158:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635228.783164:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2350:x1876568410436224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635228.783190:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2350:x1876568410436224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635228.783196:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635228.783219:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1789635228.783227:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410435968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635228.783255:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410435968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635228.783260:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00080000:3.0:1789635228.783409:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635228.783417:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635228.783423:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635228.947480:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422000000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635228.947554:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635228.947598:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000000 00000100:00100000:3.0:1789635228.947607:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000000 00000100:00100000:3.0:1789635228.947720:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635228.947732:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422000000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635228.947773:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635228.947824:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422000000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635228.947831:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789635228.947897:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789635228.947935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e717aa00 x1876568422000000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635228.947959:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422000000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635228.947984:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422000512:0@lo:400:kworker.0 00000100:00100000:3.0:1789635228.948024:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635228.948024:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422000256:0@lo:400:kworker.0 00000100:00100000:0.0:1789635228.948058:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635228.948063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635228.948072:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422000384:0@lo:400:kworker.0 00000100:00100000:0.0:1789635228.948088:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789635228.948097:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422000128:0@lo:400:kworker.0 00000100:00100000:3.0:1789635228.948109:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635228.948136:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635228.948234:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000512 00000100:00100000:0.0:1789635228.948239:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000512 00000100:00100000:0.0:1789635228.948289:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000256 00000100:00100000:0.0:1789635228.948293:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000256 00000100:00100000:0.0:1789635228.948338:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000128 00000100:00100000:0.0:1789635228.948341:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000128 00000100:00100000:0.0:1789635228.948364:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635228.948372:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422000512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635228.948378:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789635228.948390:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422000256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635228.948420:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422000512:12345-0@lo:400:kworker.0 Request processed in 51us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635228.948426:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635228.948440:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789635228.948446:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422000256:12345-0@lo:400:kworker.0 Request processed in 58us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635228.948447:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422000128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635228.948460:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789635228.948478:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422000128:12345-0@lo:400:kworker.0 Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635228.948483:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789635228.948488:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000384 00000100:00100000:3.0:1789635228.948493:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000384 00000100:00100000:0.0:1789635228.948519:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422000128:0@lo:400:kworker.0 00000100:00100000:3.0:1789635228.948530:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635228.948531:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422000256:0@lo:400:kworker.0 00000100:00100000:3.0:1789635228.948543:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422000384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635228.948558:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422000512:0@lo:400:kworker.0 00000100:00100000:3.0:1789635228.948589:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422000384:12345-0@lo:400:kworker.0 Request processed in 49us (483us total) trans 0 rc 0/0 00010000:00080000:0.0:1789635228.948596:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e71b1180 x1876568422000384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635228.948599:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789635228.948612:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422000384:0@lo:400:kworker.0 00000100:00080000:1.0:1789635228.948736:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635228.980844:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635228.980928:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436352 00000100:00100000:2.0:1789635228.980940:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436352 00000100:00100000:2.0:1789635228.981004:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:2.0:1789635228.981017:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:5583:x1876568410436352:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635228.981040:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635228.981071:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d001 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635228.981158:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635228.981172:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635228.981183:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635228.982131:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410436352:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 278us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635228.982144:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:0.0:1789635228.984039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635228.984140:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436480 00000100:00100000:2.0:1789635228.984150:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436480 00000100:00100000:2.0:1789635228.984198:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:2.0:1789635228.984206:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410436480:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635228.984543:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410436480:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 336us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635228.984551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:0.0:1789635228.987118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635228.987211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436608 00000100:00100000:2.0:1789635228.987224:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436608 00000100:00100000:2.0:1789635228.987285:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:2.0:1789635228.987295:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410436608:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635228.987571:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410436608:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 276us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635228.987580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:0.0:1789635228.994874:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635228.994936:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436736 00000100:00100000:1.0:1789635228.994949:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436736 00000100:00100000:1.0:1789635228.995013:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:1.0:1789635228.995082:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410436736:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635228.995103:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635228.995125:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d008 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.995157:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.995180:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635228.995191:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85e00, rc 0) 00000100:00100000:1.0:1789635228.995257:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410436736:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 179us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635228.995265:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:1.0:1789635228.997533:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635228.997569:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436864 00000100:00100000:2.0:1789635228.997579:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436864 00000100:00100000:2.0:1789635228.997633:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 225 00000100:00100000:2.0:1789635228.997641:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410436864:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635228.997955:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410436864:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 313us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635228.997964:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 225 00000100:00100000:0.0:1789635229.004408:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635229.004456:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410436992 00000100:00100000:0.0:1789635229.004468:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410436992 00000100:00100000:0.0:1789635229.004522:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:0.0:1789635229.004533:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410436992:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635229.004787:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410436992:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 255us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635229.004796:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 226 00000001:02000400:3.0:1789635229.208620:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789635229.718247:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635230.739520:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635231.250657:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:53:51 (1789635231) === 00000100:00100000:2.0:1789635231.369692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635231.369942:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410437120 00000100:00100000:0.0:1789635231.369955:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410437120 00000100:00100000:0.0:1789635231.370027:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789635231.370039:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e05ee327-d920-4885-acb2-a26d789e134c+6:9660:x1876568410437120:12345-192.168.201.30@tcp:700:mkdir.0 00000100:00100000:0.0:1789635231.370131:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e05ee327-d920-4885-acb2-a26d789e134c+6:9660:x1876568410437120:12345-192.168.201.30@tcp:700:mkdir.0 Request processed in 96us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635231.370139:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00080000:1.0:1789635231.371653:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635231.373864:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.374009:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410437376 00000100:00100000:3.0:1789635231.374021:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410437376 00000100:00100000:3.0:1789635231.374173:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1789635231.374185:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:9660:x1876568410437376:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:3.0:1789635231.374257:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635231.374295:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2ce7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf8a expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.374341:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.374366:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635231.374652:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.374664:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.374671:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.374679:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.374683:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.374687:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635231.375728:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789635231.375740:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.375748:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.375754:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.375759:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.375763:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.375781:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.375792:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635231.375795:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.375798:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.375803:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635231.375818:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b002499 reply state 000000006d279a87 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635231.375826:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635231.375917:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:9660:x1876568410437376:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 1734us (2061us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789635231.375924:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00010000:00010000:3.0:1789635231.377485:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.377494:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.377499:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.377502:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.377505:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.377519:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.377528:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e79d91bad00) 00010000:00010000:3.0:1789635231.377530:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.377532:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.377536:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e1b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635231.384841:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635231.384889:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410437504 00000100:00100000:0.0:1789635231.384901:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410437504 00000100:00100000:0.0:1789635231.384988:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789635231.385000:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:9661:x1876568410437504:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1789635231.385025:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635231.385052:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb2e22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d00f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.385139:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031c00/0x77332204cfbb2e29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.385165:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031c00/0x77332204cfbb2e29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.385175:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031c00/0x77332204cfbb2e29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635231.385212:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789635231.385215:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635231.385244:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031c00/0x77332204cfbb2e29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.385267:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb2e22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d00f expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.385280:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031c00/0x77332204cfbb2e29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d00f expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.385299:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635231.385302:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635231.385304:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031c00, rc 0) 00000100:00100000:0.0:1789635231.385385:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:9661:x1876568410437504:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 387us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635231.385392:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:2.0:1789635231.388202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635231.388243:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410437760 00000100:00100000:0.0:1789635231.388255:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410437760 00000100:00100000:0.0:1789635231.388341:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789635231.388353:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:9661:x1876568410437760:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1789635231.388410:0:7562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635231.388443:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031c00/0x77332204cfbb2e29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d00f expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.388458:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635231.388466:0:7562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635231.388486:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.388496:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.388502:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635231.388768:0:7562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0e43887 reply state 000000004c4216cf transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635231.388776:0:7562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789635231.388783:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789635231.388851:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:9661:x1876568410437760:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 500us (655us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789635231.388858:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00010000:00010000:3.0:1789635231.390147:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.390162:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.390170:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.390175:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.390179:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.390184:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.390195:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d088e100) 00010000:00010000:3.0:1789635231.390197:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789635231.390200:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.390215:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030000/0x77332204cfbb2e30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635231.410375:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.410613:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410437888 00000100:00100000:3.0:1789635231.410625:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410437888 00000100:00100000:3.0:1789635231.410680:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1789635231.410691:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:9662:x1876568410437888:12345-192.168.201.30@tcp:101:chown.0 00010000:00010000:3.0:1789635231.410718:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635231.410742:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d016 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.410817:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.410831:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.410843:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635231.410882:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635231.410886:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635231.410928:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.410954:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1676200/0x77332204cfbb2e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d016 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.410973:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d016 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.410996:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bad00) 00010000:00010000:3.0:1789635231.410999:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635231.411002:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1677000, rc 0) 00000100:00100000:3.0:1789635231.411062:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:9662:x1876568410437888:12345-192.168.201.30@tcp:101:chown.0 Request processed in 373us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635231.411068:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789635231.416457:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.416553:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410438016 00000100:00100000:3.0:1789635231.416565:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410438016 00000100:00100000:3.0:1789635231.416633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:3.0:1789635231.416644:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:9662:x1876568410438016:12345-192.168.201.30@tcp:101:chown.0 00010000:00010000:3.0:1789635231.416665:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635231.416686:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d01d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416780:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416795:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416806:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416824:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416830:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416847:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416949:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416957:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.416965:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635231.416997:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635231.417002:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635231.417022:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417035:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417041:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417047:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417053:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.417057:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417070:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417089:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bad00) 00010000:00010000:3.0:1789635231.417091:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.417095:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417099:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417109:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417113:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417117:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417119:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.417121:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417126:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417133:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635231.417135:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.417137:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417142:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417185:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677400/0x77332204cfbb2e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d01d expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417197:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d01d expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.417202:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.417204:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635231.417205:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73000, rc 0) 00000100:00100000:3.0:1789635231.417260:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+9:9662:x1876568410438016:12345-192.168.201.30@tcp:101:chown.0 Request processed in 620us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635231.417264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1789635231.427859:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.428065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410438272 00000100:00100000:3.0:1789635231.428077:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410438272 00000100:00100000:3.0:1789635231.428136:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1789635231.428147:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:9662:x1876568410438272:12345-192.168.201.30@tcp:36:chown.0 00010000:00010000:3.0:1789635231.428209:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635231.428237:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d01d expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.428256:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.428267:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635231.428303:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.428341:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.428359:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789635231.451638:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1789635231.451661:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789635231.452074:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a035143 reply state 00000000d609c032 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635231.452085:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789635231.452100:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789635231.452226:0:5844:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789635231.452245:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:9662:x1876568410438272:12345-192.168.201.30@tcp:36:chown.0 Request processed in 24096us (24394us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789635231.452257:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00010000:00010000:3.0:1789635231.452275:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.452297:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.452306:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.452626:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.452631:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.452640:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.452657:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:3.0:1789635231.452659:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789635231.452664:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.452671:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635231.460502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.460714:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410438400 00000100:00100000:3.0:1789635231.460727:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410438400 00000100:00100000:3.0:1789635231.460835:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1789635231.460844:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:9663:x1876568410438400:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:3.0:1789635231.460867:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635231.460885:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d024 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635231.461902:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 969us 00010000:00010000:3.0:1789635231.468659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.468684:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.468696:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.468712:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.468719:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.468727:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469058:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469067:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469073:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635231.469103:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635231.469119:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635231.469163:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469176:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469183:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469190:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469196:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.469201:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469209:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469223:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bad00) 00010000:00010000:3.0:1789635231.469226:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.469230:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469237:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469249:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469264:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469270:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469275:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.469278:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469294:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469304:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e79d91bac00) 00010000:00010000:3.0:1789635231.469306:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.469327:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469335:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2e76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469377:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d024 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469393:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d024 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.469401:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.469404:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635231.469412:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73400, rc 0) 00000100:00100000:3.0:1789635231.469486:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:9663:x1876568410438400:12345-192.168.201.30@tcp:101:touch.500 Request processed in 8641us (8991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635231.469496:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1789635231.472516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635231.472576:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410438656 00000100:00100000:0.0:1789635231.472599:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410438656 00000100:00100000:0.0:1789635231.472658:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789635231.472670:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:9663:x1876568410438656:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:0.0:1789635231.472691:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635231.472711:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb2e84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d02b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.473004:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.473028:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.473050:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.473073:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.473085:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.473092:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635231.473885:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789635231.474151:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474162:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474170:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474208:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474227:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474234:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474241:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635231.474246:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474254:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474266:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:0.0:1789635231.474269:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635231.474274:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474280:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb2e8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635231.474306:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047f795df reply state 00000000b738296e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635231.474409:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789635231.474441:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb2e84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d02b expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474456:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d02b expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.474477:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635231.474479:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635231.474482:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031400, rc 0) 00000100:00100000:0.0:1789635231.474558:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+10:9663:x1876568410438656:12345-192.168.201.30@tcp:101:touch.500 Request processed in 1891us (2061us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789635231.474567:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00010000:00010000:3.0:1789635231.477619:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.477637:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.477645:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.477651:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.477656:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.477664:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635231.477676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1789635231.477690:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4588ff08 (ffff9e79d088e100) 00010000:00010000:3.0:1789635231.477694:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.477701:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635231.477729:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410438912 00000100:00100000:0.0:1789635231.477741:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410438912 00010000:00010000:3.0:1789635231.477746:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb2e92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635231.477799:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1789635231.477810:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:9663:x1876568410438912:12345-192.168.201.30@tcp:36:touch.500 00010000:00010000:0.0:1789635231.477875:0:7562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635231.477910:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d02b expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.477924:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635231.477931:0:7562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635231.477984:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.477997:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.478018:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635231.478165:0:7562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a59c365b reply state 000000008be43af2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635231.478191:0:7562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635231.478274:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+10:9663:x1876568410438912:12345-192.168.201.30@tcp:36:touch.500 Request processed in 466us (607us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789635231.478281:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00010000:00010000:3.0:1789635231.479494:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.479508:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.479525:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.479531:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.479535:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.479543:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.479557:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d088e200) 00010000:00010000:3.0:1789635231.479560:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.479564:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.479570:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2ea7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635231.480029:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635231.480176:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410439040 00000100:00100000:2.0:1789635231.480186:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410439040 00000100:00100000:2.0:1789635231.480243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1789635231.480262:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:9663:x1876568410439040:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:2.0:1789635231.480296:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635231.480354:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb2eae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d032 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.480420:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb2eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d032 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.480436:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb2eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d032 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.480453:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635231.480456:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635231.480459:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820200, rc 0) 00000100:00100000:2.0:1789635231.480508:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+10:9663:x1876568410439040:12345-192.168.201.30@tcp:101:touch.500 Request processed in 257us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635231.480515:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1789635231.483103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635231.483177:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410439168 00000100:00100000:1.0:1789635231.483187:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410439168 00000100:00100000:1.0:1789635231.483236:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789635231.483246:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876568410439168:12345-192.168.201.30@tcp:8:touch.500 00010000:00080000:1.0:1789635231.483294:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1789635231.483356:0:6693:0:(genops.c:1384:class_connect()) connect: client e05ee327-d920-4885-acb2-a26d789e134c, cookie 0x77332204cfbb2eb5 00002000:00100000:1.0:1789635231.483371:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e05ee327-d920-4885-acb2-a26d789e134c/ffff9e79c7346000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789635231.483398:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789635231.483686:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789635231.483716:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79c7345000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635231.483787:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2347:x1876568410439168:12345-192.168.201.30@tcp:8:touch.500 Request processed in 533us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635231.483811:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789635231.486395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.486858:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410439296 00000100:00100000:3.0:1789635231.486868:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410439296 00000100:00100000:3.0:1789635231.486954:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1789635231.486966:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:0:x1876568410439296:12345-192.168.201.30@tcp:2:touch.500 00000100:00080000:1.0:1789635231.487390:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789635231.514574:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000001:00080000:1.0:1789635231.514589:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789635231.514765:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:0:x1876568410439296:12345-192.168.201.30@tcp:2:touch.500 Request processed in 27796us (28382us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789635231.514773:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789635231.518670:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635231.518736:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410439552 00000100:00100000:2.0:1789635231.518748:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410439552 00000100:00100000:2.0:1789635231.518810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1789635231.518821:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+10:9663:x1876568410439552:12345-192.168.201.30@tcp:35:touch.500 00000100:00100000:2.0:1789635231.519386:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+11:9663:x1876568410439552:12345-192.168.201.30@tcp:35:touch.500 Request processed in 566us (722us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789635231.519395:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1789635231.531995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.532763:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410439680 00000100:00100000:3.0:1789635231.532777:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410439680 00000100:00100000:3.0:1789635231.532856:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1789635231.532868:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+11:9664:x1876568410439680:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1789635231.532919:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635231.532942:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d039 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.533024:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.533040:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.533052:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635231.533106:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635231.533111:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635231.533174:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.533206:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d039 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.533226:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d039 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.533235:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.533238:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635231.533242:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73800, rc 0) 00000100:00100000:3.0:1789635231.533384:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+12:9664:x1876568410439680:12345-192.168.201.30@tcp:101:rm.0 Request processed in 518us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635231.533392:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1789635231.536699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635231.536799:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410439936 00000100:00100000:1.0:1789635231.536808:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410439936 00000100:00100000:1.0:1789635231.536859:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1789635231.536867:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+12:9664:x1876568410439936:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1789635231.536885:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635231.536907:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d040 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635231.536998:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789635231.537157:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2eca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d040 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.537169:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bad00) 00010000:00010000:1.0:1789635231.537172:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635231.537175:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d040 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.537185:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84600, rc 0) 00000100:00100000:1.0:1789635231.537362:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:9664:x1876568410439936:12345-192.168.201.30@tcp:101:rm.0 Request processed in 494us (670us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789635231.537370:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1789635231.542005:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.543771:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410440064 00000100:00100000:3.0:1789635231.543786:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410440064 00000100:00100000:3.0:1789635231.543849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1789635231.543860:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:9664:x1876568410440064:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1789635231.550362:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:9664:x1876568410440064:12345-192.168.201.30@tcp:37:rm.0 Request processed in 6493us (8356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635231.550378:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1789635231.553399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635231.553537:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410440320 00000100:00100000:2.0:1789635231.553561:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410440320 00000100:00100000:2.0:1789635231.553614:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789635231.553625:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+13:9664:x1876568410440320:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1789635231.553902:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+14:9664:x1876568410440320:12345-192.168.201.30@tcp:35:rm.0 Request processed in 278us (514us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789635231.553911:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1789635231.557691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.558657:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410440576 00000100:00100000:3.0:1789635231.558670:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410440576 00000100:00100000:3.0:1789635231.558749:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1789635231.558760:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+14:9664:x1876568410440576:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1789635231.558788:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635231.558809:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2ed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d047 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.558919:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2edf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.558932:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.558942:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635231.558952:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789635231.559075:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d047 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.559093:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d047 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.559101:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.559116:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635231.559120:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:3.0:1789635231.559187:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+16:9664:x1876568410440576:12345-192.168.201.30@tcp:101:rm.0 Request processed in 429us (1504us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789635231.559194:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1789635231.566463:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635231.566703:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410440704 00000100:00100000:1.0:1789635231.566714:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410440704 00000100:00100000:1.0:1789635231.566778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1789635231.566789:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+16:9664:x1876568410440704:12345-192.168.201.30@tcp:41:rm.0 00000004:00000024:1.0:1789635231.566854:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789635231.566933:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+16:9664:x1876568410440704:12345-192.168.201.30@tcp:41:rm.0 Request processed in 145us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635231.566941:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:2.0:1789635231.570008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.570107:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410440832 00000100:00100000:3.0:1789635231.570119:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410440832 00000100:00100000:3.0:1789635231.570182:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1789635231.570193:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+16:9664:x1876568410440832:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1789635231.570216:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635231.570239:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d04e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570378:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570393:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570406:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570435:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570444:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570461:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570603:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb2f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570612:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb2f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570619:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb2f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635231.570651:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789635231.570656:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635231.570676:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb2f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570689:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb2f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570699:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570706:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570713:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570721:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.570725:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570733:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570753:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.570757:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.570761:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570769:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570784:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570790:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570796:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570802:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.570805:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570812:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570820:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4588ff08 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635231.570822:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.570825:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570831:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570877:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d04e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570891:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb2f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d04e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.570899:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635231.570901:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635231.570904:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73c00, rc 0) 00000100:00100000:3.0:1789635231.570962:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+17:9664:x1876568410440832:12345-192.168.201.30@tcp:101:rm.0 Request processed in 770us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635231.570970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:0.0:1789635231.575749:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635231.577699:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410441088 00000100:00100000:1.0:1789635231.577716:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410441088 00000100:00100000:1.0:1789635231.577787:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1789635231.577798:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+17:9664:x1876568410441088:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1789635231.577860:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789635231.577892:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb2f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d04e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.577917:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb2eae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d032 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.577929:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:1.0:1789635231.577950:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb2ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d039 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.577980:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:1.0:1789635231.577983:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635231.578006:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578020:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578030:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578049:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578057:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578064:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578191:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578200:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.578207:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635231.579354:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789635231.579368:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207399056195ns, next at 208399053059ns, rc = 0 00010000:00010000:1.0:1789635231.579628:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579643:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579653:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579661:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579667:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579674:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579697:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635231.579719:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579725:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579731:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579737:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635231.579742:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579749:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635231.579751:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579759:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579778:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635231.579779:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d898af00) 00010000:00010000:1.0:1789635231.579784:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789635231.579788:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579793:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579795:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175400/0x77332204cfbb2f17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579812:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579826:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579827:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e79d898af00) 00010000:00010000:0.0:1789635231.579833:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789635231.579839:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579839:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579855:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175e00/0x77332204cfbb2f1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579857:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579871:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635231.579873:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579889:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635231.579908:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:1.0:1789635231.579912:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635231.579915:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579921:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635231.579922:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb2f09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.579925:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635231.579929:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1789635231.579949:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025b6f40f reply state 000000002b96d05a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635231.579956:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635231.580094:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+16:9664:x1876568410441088:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2295us (4354us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789635231.580102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00010000:00010000:3.0:1789635231.581761:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.581783:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.581792:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.581799:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.581805:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.581814:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.581834:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4588ff08 (ffff9e79d898a600) 00010000:00010000:3.0:1789635231.581853:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.581859:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.581865:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb2f10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635231.583715:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635231.583808:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410441344 00000100:00100000:1.0:1789635231.583819:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410441344 00000100:00100000:1.0:1789635231.583875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789635231.583884:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:9664:x1876568410441344:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1789635231.584151:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+16:9664:x1876568410441344:12345-192.168.201.30@tcp:35:rm.0 Request processed in 267us (444us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789635231.584159:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789635231.586441:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635231.588932:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410441600 00000100:00100000:3.0:1789635231.588954:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410441600 00000100:00100000:3.0:1789635231.589036:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1789635231.589050:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+16:9664:x1876568410441600:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1789635231.589121:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789635231.589153:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d047 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589184:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73400/0x77332204cfbb2e7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d024 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589197:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91ba100) 00010000:00010000:3.0:1789635231.589214:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c1677000/0x77332204cfbb2e3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d016 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589224:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bad00) 00010000:00010000:3.0:1789635231.589230:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635231.589258:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589272:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589362:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589379:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589386:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.589394:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.590516:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.590531:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.590541:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635231.592560:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789635231.592584:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592594:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592602:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592609:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635231.592614:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592622:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592647:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e79d91f3900) 00010000:00010000:2.0:1789635231.592650:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789635231.592656:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592675:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2f33 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592705:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592712:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592717:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592723:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635231.592726:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592733:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592741:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:2.0:1789635231.592743:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635231.592746:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635231.592752:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb2f25 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635231.592777:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dae0602a reply state 00000000c8ea83e3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635231.592788:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635231.592896:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+15:9664:x1876568410441600:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3847us (6458us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789635231.592906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00010000:00010000:3.0:1789635231.596253:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.596275:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.596296:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.596303:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635231.596308:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.596345:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.596366:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e79d91bac00) 00010000:00010000:3.0:1789635231.596369:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635231.596375:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635231.596400:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72c00/0x77332204cfbb2f2c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635231.763499:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635232.532583:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422000640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635232.532657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635232.532882:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000640 00000100:00100000:3.0:1789635232.532893:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000640 00000100:00100000:3.0:1789635232.532984:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635232.532993:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422000640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635232.533031:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635232.533086:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422000640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635232.533091:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789635232.533153:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73c700 x1876568422000640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635232.533176:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422000640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789635232.533294:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635232.788355:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635233.812646:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635233.906623:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635233.906669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410441728 00000100:00100000:2.0:1789635233.906681:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410441728 00000100:00100000:2.0:1789635233.906742:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:2.0:1789635233.906753:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410441728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635233.906837:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410441728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635233.906845:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:3.0:1789635233.909472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635233.909535:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635233.909543:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410441984 00000100:00100000:1.0:1789635233.909560:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410441984 00000100:00100000:3.0:1789635233.909583:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410441856 00000100:00100000:3.0:1789635233.909595:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410441856 00000100:00100000:1.0:1789635233.909657:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1789635233.909673:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410441984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635233.909682:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:3.0:1789635233.909699:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:2348:x1876568410441856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635233.909782:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:2348:x1876568410441856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635233.909782:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410441984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635233.909812:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:1.0:1789635233.909829:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00080000:1.0:1789635233.909868:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635233.909875:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635233.912217:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635233.912670:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410442112 00000100:00100000:0.0:1789635233.912680:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410442112 00000100:00100000:0.0:1789635233.912751:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789635233.912761:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410442112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635233.912832:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410442112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (620us total) trans 0 rc 0/0 00000100:00080000:1.0:1789635233.912833:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635233.912843:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1789635233.913375:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635233.913493:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410442240 00000100:00100000:1.0:1789635233.913502:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410442240 00000100:00100000:1.0:1789635233.913566:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1789635233.913577:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2347:x1876568410442240:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:1.0:1789635233.913608:0:8106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2dc7 00000100:00080000:1.0:1789635233.913620:0:8106:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5f7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789635233.913666:0:8106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789635233.914123:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+2:2347:x1876568410442240:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 545us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635233.914134:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00080000:1.0:1789635233.914158:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635233.914383:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635233.915643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635233.915716:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410442368 00000100:00100000:1.0:1789635233.915727:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410442368 00000100:00080000:3.0:1789635233.915792:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635233.915802:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1789635233.915816:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2347:x1876568410442368:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:1.0:1789635233.915842:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2dce 00000100:00080000:1.0:1789635233.915851:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5f1000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789635233.915890:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789635233.915895:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789635233.916174:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+2:2347:x1876568410442368:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 361us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635233.916184:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000001:02000400:2.0:1789635233.917889:0:11618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789635234.067621:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422000768:0@lo:400:kworker.0 00000100:00100000:0.0:1789635234.067707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.067813:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000768 00000100:00100000:2.0:1789635234.067823:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000768 00000100:00100000:2.0:1789635234.067874:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789635234.067884:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422000768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635234.068148:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422000768:12345-0@lo:400:kworker.0 Request processed in 263us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.068159:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789635234.068179:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422001152:0@lo:400:kworker.0 00000100:00100000:1.0:1789635234.068193:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422001024:0@lo:400:kworker.0 00000100:00100000:3.0:1789635234.068249:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.068256:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789635234.068285:0:7651:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 209887972348ns, next at 210887969603ns, rc = 0 00000100:00100000:3.0:1789635234.068292:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635234.068302:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422001280:0@lo:400:kworker.0 00000100:00100000:2.0:1789635234.068353:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422001152 00000100:00100000:2.0:1789635234.068358:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422001152 00000100:00100000:2.0:1789635234.068396:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635234.068404:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422001152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635234.068486:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e717aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422000768:0@lo:400:kworker.0 00000100:00100000:0.0:1789635234.068533:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422000896:0@lo:400:kworker.0 00000100:00100000:1.0:1789635234.068979:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422001536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635234.069093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.069102:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422001152:12345-0@lo:400:kworker.0 Request processed in 697us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.069111:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635234.069128:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422001280 00000100:00100000:2.0:1789635234.069132:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422001280 00010000:00080000:3.0:1789635234.069137:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d6d80 x1876568422001152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635234.069152:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422001152:0@lo:400:kworker.0 00000100:00100000:2.0:1789635234.069162:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789635234.069172:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422001280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635234.069185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422001024 00000100:00100000:3.0:1789635234.069191:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422001024 00000100:00100000:2.0:1789635234.069209:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422001280:12345-0@lo:400:kworker.0 Request processed in 39us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.069216:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789635234.069231:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789635234.069250:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422001024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635234.069287:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422001024:12345-0@lo:400:kworker.0 Request processed in 50us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.069294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789635234.069330:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635234.069336:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635234.069339:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789635234.069382:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fd5d5500 x1876568422001280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635234.069392:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422001280:0@lo:400:kworker.0 00000100:00100000:0.0:1789635234.072400:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635234.072454:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422001408:0@lo:400:kworker.0 00000100:00100000:3.0:1789635234.072480:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422000896 00000100:00100000:3.0:1789635234.072489:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422000896 00000100:00100000:0.0:1789635234.072494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635234.072602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422001408 00000100:00100000:3.0:1789635234.072607:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422001408 00000100:00100000:3.0:1789635234.072640:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635234.072649:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789635234.072650:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422000896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635234.072666:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422001408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635234.072719:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422000896:12345-0@lo:400:kworker.0 Request processed in 73us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.072725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789635234.072760:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635234.073053:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.073094:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422001024:0@lo:400:kworker.0 00000100:00100000:3.0:1789635234.073104:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422001536 00000100:00100000:3.0:1789635234.073110:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422001536 00000100:00100000:3.0:1789635234.073154:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789635234.073162:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422001536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635234.073207:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635234.073264:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422001536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.073271:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789635234.073300:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73c700 x1876568422001536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635234.073334:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422001536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635234.074084:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422001408:12345-0@lo:400:kworker.0 Request processed in 1422us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635234.074103:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789635234.074179:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422000896:0@lo:400:kworker.0 00000100:00100000:3.0:1789635234.074277:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422001408:0@lo:400:kworker.0 00000020:00000080:0.0:1789635234.531160:0:11666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd05a2e820 20000000:00000080:0.0:1789635234.531179:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e79e7c5a400 uarg=0000000000000000 20000000:01000000:0.0:1789635234.533098:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789635234.533108:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789635234.533114:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789635234.535295:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789635234.535578:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789635234.543456:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789635234.543509:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789635234.543557:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789635234.543575:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789635234.543595:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543614:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543622:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2dea expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543629:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543638:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543645:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543651:0:11666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543697:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543712:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 12 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.543728:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422001664:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635234.543843:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543852:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.543860:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422001792:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635234.543887:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543895:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 18 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.543903:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422001920:0@lo:104: 00000100:00100000:1.0:1789635234.543941:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635234.543976:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2dea expref: 18 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.543985:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2dea expref: 18 pid: 7647 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.543998:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422001920 00000100:00100000:1.0:1789635234.544005:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422002048:0@lo:104: 00000100:00100000:2.0:1789635234.544009:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422001920 00000100:00100000:1.0:1789635234.544032:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.544514:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789635234.544520:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.544528:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002048 00010000:00010000:1.0:1789635234.544532:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 18 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.544534:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002048 00000100:00100000:1.0:1789635234.544545:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422002176:0@lo:104: 00000100:00100000:1.0:1789635234.544567:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635234.544577:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024780 going to sleep for 11 seconds 00000100:00100000:2.0:1789635234.544633:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002176 00000100:00100000:2.0:1789635234.544644:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002176 00000100:00100000:3.0:1789635234.544658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635234.544673:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:11666:x1876568422001920:12345-0@lo:104: 00010000:00010000:3.0:1789635234.544687:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.544747:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635234.544753:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+5:11666:x1876568422001920:12345-0@lo:104: Request processed in 85us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.544760:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789635234.544789:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789635234.544797:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789635234.544799:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635234.544806:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc0bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:11666:x1876568422002048:12345-0@lo:104: 00010000:00010000:2.0:1789635234.544817:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84400 already unused, calling callback (ffffffffc1bf6c20) 00010000:00010000:3.0:1789635234.544819:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.544823:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.544838:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.544847:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.544853:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635234.544857:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635234.544863:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc0bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+4:11666:x1876568422002048:12345-0@lo:104: Request processed in 60us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.544875:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789635234.544889:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.544898:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789635234.544910:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789635234.544918:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:11666:x1876568422002176:12345-0@lo:104: 00010000:00010000:2.0:1789635234.544921:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.544926:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.544932:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb2df8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2dff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.544947:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635234.544951:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.544957:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030a00 already unused, calling callback (ffffffffc1bf6c20) 00010000:00010000:3.0:1789635234.544965:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789635234.544967:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635234.544972:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+3:11666:x1876568422002176:12345-0@lo:104: Request processed in 55us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635234.544982:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789635234.544982:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635234.544992:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635234.544999:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635234.545000:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635234.545006:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.545013:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc1bf6c20) 00010000:00010000:2.0:1789635234.545016:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635234.545017:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.545033:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635234.545041:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.545048:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c0030a00/0x77332204cfbb2dea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2df1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.545058:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635234.545059:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635234.545061:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635234.545074:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422002304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635234.545106:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.545129:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635234.545135:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422002432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635234.545155:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.545182:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002304 00000100:00100000:2.0:1789635234.545186:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002304 00010000:00010000:2.0:1789635234.545216:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 19 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.545254:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422001920:0@lo:104: 00000100:00100000:1.0:1789635234.545264:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422002048:0@lo:104: 00000100:00100000:1.0:1789635234.545271:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422002176:0@lo:104: 00010000:00010000:3.0:1789635234.545305:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635234.545331:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635234.545337:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635234.545353:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.545359:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635234.545389:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.545395:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85200/0x77332204cfbb2ddc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb2de3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635234.545409:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635234.545410:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635234.545412:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635234.545426:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635234.545859:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422002560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635234.545892:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635234.546040:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002432 00000100:00100000:2.0:1789635234.546046:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002432 00000100:00100000:1.0:1789635234.546050:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002560 00000100:00100000:1.0:1789635234.546056:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002560 00010000:00010000:2.0:1789635234.546068:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2dea expref: 21 pid: 7647 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.546077:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 21 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.546091:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789635234.546101:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+21:3308:x1876568422002304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635234.546113:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635234.546118:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 21 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.546129:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 21 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.546145:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb2dff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2df8 expref: 21 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.546160:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1789635234.546161:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.546171:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3308:x1876568422002432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635234.546181:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.546187:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2dea expref: 20 pid: 7647 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.546202:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+20:3308:x1876568422002304:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (1093us total) trans 0 rc 0/0 00010000:00010000:1.0:1789635234.546215:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2dea expref: 20 pid: 7647 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.546216:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1789635234.546245:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676000/0x77332204cfbb2df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2dea expref: 19 pid: 7647 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635234.546252:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789635234.546259:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635234.546264:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3306:x1876568422002560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635234.546275:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635234.546279:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 18 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.546288:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3308:x1876568422002432:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1130us total) trans 0 rc 0/0 00010000:00010000:2.0:1789635234.546301:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 18 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.546302:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1789635234.546339:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1677a00/0x77332204cfbb2de3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb2ddc expref: 17 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.546350:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635234.546388:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3306:x1876568422002560:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635234.546393:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789635234.546419:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422002432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635234.546425:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422002304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635234.546544:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422002560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635234.546881:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422001664:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635234.546956:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1876568422001792:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635234.546982:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635234.550194:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635234.550288:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635234.550456:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410442496 00000100:00100000:1.0:1789635234.550467:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410442496 00010000:00010000:1.0:1789635234.550502:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 13 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.550532:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410442624 00000100:00100000:1.0:1789635234.550535:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410442624 00010000:00010000:1.0:1789635234.550546:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 14 pid: 7647 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635234.550577:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635234.550587:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+14:2348:x1876568410442496:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635234.550603:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.550609:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 14 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550622:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 14 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550656:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85e00/0x77332204cfbb2e0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d008 expref: 14 pid: 5835 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550669:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.550719:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410442496:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 133us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.550726:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635234.550774:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:1.0:1789635234.550780:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:2348:x1876568410442624:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635234.550787:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635234.550791:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550800:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550809:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821c00/0x77332204cfbb2e06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d001 expref: 12 pid: 7647 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550819:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550839:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550854:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550870:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550877:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550883:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550890:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635234.550894:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550903:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550915:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635234.550934:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635234.550953:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:2348:x1876568410442624:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635234.550960:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00010000:00010000:2.0:1789635234.551467:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.551478:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635234.551483:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f3a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635234.835468:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789635235.133355:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00000020:00000080:3.0:1789635235.133368:0:6717:0:(genops.c:885:class_export_put()) final put ffff9e79fe5f7000/2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00000020:00000080:0.0:1789635235.133530:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe5f7000/2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 for lustre-OST0000 00000020:00000080:0.0:1789635235.133630:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fe5f7800 for lustre-OST0000 00000100:00100000:2.0:1789635235.630911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635235.631198:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410442752 00000100:00100000:3.0:1789635235.631222:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410442752 00000100:00100000:3.0:1789635235.631280:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:3.0:1789635235.631302:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:5583:x1876568410442752:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635235.631348:0:7647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635235.631370:0:7647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79e7c73400/0x77332204cfbb2f41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d055 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635235.631398:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c73400/0x77332204cfbb2f41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d055 expref: 12 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635235.631411:0:7647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79e7c73400/0x77332204cfbb2f41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d055 expref: 12 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635235.631421:0:7647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73400, rc 0) 00000100:00100000:3.0:1789635235.631496:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410442752:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 206us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635235.631515:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:3.0:1789635235.635199:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635235.635491:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410442880 00000100:00100000:2.0:1789635235.635515:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410442880 00000100:00100000:2.0:1789635235.635628:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:2.0:1789635235.635639:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410442880:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635235.635944:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410442880:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 306us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635235.635952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:0.0:1789635235.644148:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635235.644261:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443008 00000100:00100000:3.0:1789635235.644271:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443008 00000100:00100000:3.0:1789635235.644366:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:3.0:1789635235.644378:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410443008:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635235.644614:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410443008:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 239us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635235.644620:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:3.0:1789635235.652236:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635235.653557:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443136 00000100:00100000:0.0:1789635235.653573:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443136 00000100:00100000:0.0:1789635235.653648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:0.0:1789635235.653659:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:9933:x1876568410443136:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635235.653939:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:9933:x1876568410443136:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 281us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635235.653947:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:0.0:1789635235.665685:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635235.665875:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443264 00000100:00100000:3.0:1789635235.665888:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443264 00000100:00100000:3.0:1789635235.665947:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:3.0:1789635235.665960:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:9933:x1876568410443264:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635235.666271:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:9933:x1876568410443264:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 312us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635235.666300:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:1.0:1789635235.669043:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635235.669269:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443392 00000100:00100000:0.0:1789635235.669298:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443392 00000100:00100000:0.0:1789635235.669383:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 234 00000100:00100000:0.0:1789635235.669394:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:5583:x1876568410443392:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635235.669413:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635235.669444:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0030000/0x77332204cfbb2f48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d05c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635235.669475:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030000/0x77332204cfbb2f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d05c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635235.669488:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0030000/0x77332204cfbb2f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d05c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635235.669498:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030000, rc 0) 00000100:00100000:0.0:1789635235.669559:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410443392:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 167us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635235.669566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 234 00000100:00100000:0.0:1789635235.675630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635235.675707:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443520 00000100:00100000:3.0:1789635235.675718:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443520 00000100:00100000:3.0:1789635235.675770:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 235 00000100:00100000:3.0:1789635235.675778:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410443520:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635235.676023:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410443520:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 246us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635235.676029:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 235 00000100:00100000:3.0:1789635235.677595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635235.677698:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443648 00000100:00100000:0.0:1789635235.677704:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443648 00000100:00100000:0.0:1789635235.677774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00100000:0.0:1789635235.677781:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410443648:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635235.677937:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:5583:x1876568410443648:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 156us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635235.677942:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00100000:1.0:1789635235.679899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635235.685005:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443776 00000100:00100000:2.0:1789635235.685021:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443776 00000100:00100000:2.0:1789635235.685090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 237 00000100:00100000:2.0:1789635235.685098:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:9936:x1876568410443776:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635235.685390:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:9936:x1876568410443776:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 292us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635235.685398:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 237 00000100:00100000:3.0:1789635235.689786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635235.689902:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410443904 00000100:00100000:2.0:1789635235.689913:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410443904 00000100:00100000:2.0:1789635235.689971:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:2.0:1789635235.689981:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:9936:x1876568410443904:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789635235.690281:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:9936:x1876568410443904:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 300us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635235.690289:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 238 00010000:00010000:1.0:1789635235.859672:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789635236.371714:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789635236.371724:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fe5fc000 from 7 10000000:01000000:3.0:1789635236.371735:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635236.371788:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635236.371800:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635236.371909:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635236.371939:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422002688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789635236.372023:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635236.372103:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7939780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635236.372207:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002688 00000100:00100000:0.0:1789635236.372217:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002688 00000100:00100000:0.0:1789635236.372278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789635236.372287:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:5839:x1876568422002688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635236.372300:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635236.372342:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2f56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2f4f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.372386:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2f56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2f4f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.372397:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2f56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2f4f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.372405:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031c00, rc 0) 00000100:00100000:0.0:1789635236.372454:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568422002688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635236.372461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789635236.372549:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422002688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635236.372562:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635236.372570:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635236.372622:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422002816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635236.372646:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635236.372673:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7939780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635236.372725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002816 00000100:00100000:0.0:1789635236.372729:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002816 00000100:00100000:0.0:1789635236.372763:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789635236.372771:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568422002816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635236.373040:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568422002816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635236.373047:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789635236.373724:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422002816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.373765:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422002944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.373829:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.373863:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da0243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635236.374154:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422002944 00000100:00100000:0.0:1789635236.374161:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422002944 00000100:00100000:0.0:1789635236.374224:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789635236.374232:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568422002944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635236.374637:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568422002944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 405us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635236.374645:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789635236.374737:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422002944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635236.375354:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11680:1876568422003072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635236.375401:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635236.375433:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789635236.375486:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003072 00000100:00100000:0.0:1789635236.375491:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003072 00000100:00100000:0.0:1789635236.375576:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789635236.375585:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:11680:x1876568422003072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635236.375732:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:11680:x1876568422003072:12345-0@lo:502:llog_process_th.0 Request processed in 149us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635236.375738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789635236.375805:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11680:1876568422003072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789635236.375829:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635236.375843:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635236.375845:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789635236.375851:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e79fe5fc000 00000020:00000080:2.0:1789635236.375853:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789635236.375973:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11680:1876568422003200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635236.376004:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635236.380323:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003200 00000100:00100000:2.0:1789635236.380336:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635236.380337:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003200 00000100:00100000:3.0:1789635236.380396:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789635236.380411:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:11680:x1876568422003200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635236.380680:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:11680:x1876568422003200:12345-0@lo:502:llog_process_th.0 Request processed in 271us (4675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635236.381391:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11680:1876568422003200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635236.381429:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635236.381436:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635236.381438:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789635236.381443:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789635236.381516:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789635236.381536:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635236.381548:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.381559:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635236.381571:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635236.381573:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fb977800 from 7 10000000:01000000:1.0:1789635236.381576:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635236.381608:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.381617:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.381626:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635236.381646:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.381690:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.381714:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da0249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635236.381728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003328 00000100:00100000:1.0:1789635236.381732:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003328 00000100:00100000:3.0:1789635236.381993:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789635236.382894:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789635236.382916:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:5839:x1876568422003328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635236.382929:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635236.382944:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2f64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2f5d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.382964:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2f64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2f5d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.382971:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2f64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2f5d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.382979:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175400, rc 0) 00000100:00100000:1.0:1789635236.383019:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568422003328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635236.383025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789635236.383042:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635236.383056:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.383065:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635236.383122:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635236.383153:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635236.383194:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635236.383376:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003456 00000100:00100000:3.0:1789635236.383382:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003456 00000100:00100000:3.0:1789635236.383409:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789635236.383415:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568422003456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635236.383646:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568422003456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635236.383653:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789635236.383681:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635236.383709:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635236.383746:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635236.383761:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7939900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635236.383772:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003584 00000100:00100000:3.0:1789635236.383775:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003584 00000100:00100000:3.0:1789635236.383794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789635236.383799:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568422003584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635236.383945:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568422003584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635236.383952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789635236.384118:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.384763:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11683:1876568422003712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635236.384803:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.384869:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635236.384901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003712 00000100:00100000:3.0:1789635236.384907:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003712 00000100:00100000:3.0:1789635236.385421:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789635236.385438:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:11683:x1876568422003712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635236.385660:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:11683:x1876568422003712:12345-0@lo:502:llog_process_th.0 Request processed in 224us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635236.385668:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789635236.385733:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11683:1876568422003712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635236.385758:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635236.385769:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635236.385772:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789635236.385780:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e79fb977800 00000020:00000080:0.0:1789635236.385783:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789635236.385861:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11683:1876568422003840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635236.385903:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635236.385980:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45000 going to sleep for 11 seconds 00000100:00100000:1.0:1789635236.386600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003840 00000100:00100000:1.0:1789635236.386608:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003840 00000100:00100000:1.0:1789635236.386641:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789635236.386648:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:11683:x1876568422003840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635236.386800:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:11683:x1876568422003840:12345-0@lo:502:llog_process_th.0 Request processed in 152us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635236.386807:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789635236.386848:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11683:1876568422003840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635236.386874:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635236.386880:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635236.386882:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789635236.386886:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789635236.387012:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789635236.387035:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635236.387044:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.387055:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635236.387066:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635236.387068:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79c8241800 from 7 10000000:01000000:1.0:1789635236.387071:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635236.387097:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.387106:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.387115:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635236.387130:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.387160:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.387206:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635236.387218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422003968 00000100:00100000:1.0:1789635236.387221:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422003968 00000100:00100000:1.0:1789635236.387242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789635236.387366:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:5839:x1876568422003968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635236.387375:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635236.387387:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb2f6b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.387407:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb2f6b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.387418:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb2f6b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.387426:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175a00, rc 0) 00000100:00100000:1.0:1789635236.387455:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568422003968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635236.387462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789635236.387489:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422003968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635236.387500:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.387509:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635236.387545:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422004096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.387568:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.387586:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635236.387596:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004096 00000100:00100000:1.0:1789635236.387598:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004096 00000100:00100000:1.0:1789635236.387613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789635236.387623:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568422004096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.387814:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568422004096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635236.387821:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789635236.387847:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422004096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.387870:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422004224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.387903:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.387915:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635236.387925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004224 00000100:00100000:1.0:1789635236.387928:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004224 00000100:00100000:1.0:1789635236.387943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789635236.387948:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568422004224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.388053:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:5839:x1876568422004224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635236.388059:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789635236.388097:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ec8828bc-aabc-4548-96aa-655e15bcddbb:5839:1876568422004224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635236.388639:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11684:1876568422004352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635236.388672:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.388691:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004352 00000100:00100000:1.0:1789635236.388695:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004352 00000100:00100000:1.0:1789635236.388717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789635236.388723:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:11684:x1876568422004352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635236.388840:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:11684:x1876568422004352:12345-0@lo:502:llog_process_th.0 Request processed in 116us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635236.388855:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789635236.388888:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635236.388901:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11684:1876568422004352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635236.388920:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635236.388929:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635236.388931:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789635236.388937:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e79c8241800 00000020:00000080:1.0:1789635236.388939:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789635236.389000:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11684:1876568422004480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635236.389031:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635236.389047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004480 00000100:00100000:1.0:1789635236.389051:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004480 00000100:00100000:1.0:1789635236.389070:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789635236.389076:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:11684:x1876568422004480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635236.389188:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:11684:x1876568422004480:12345-0@lo:502:llog_process_th.0 Request processed in 111us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635236.389194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789635236.389231:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635236.389242:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ec8828bc-aabc-4548-96aa-655e15bcddbb:11684:1876568422004480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635236.389353:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635236.389358:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635236.389359:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789635236.389363:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789635236.389403:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789635236.389417:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635236.389424:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635236.389442:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635236.394539:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1789635236.649178:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00000020:00000080:1.0:1789635236.649189:0:7663:0:(genops.c:885:class_export_put()) final put ffff9e79fe5f1800/2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00000020:00000080:2.0:1789635236.649278:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe5f1800/2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 for lustre-OST0001 00000020:00000080:2.0:1789635236.650033:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fe5f1000 for lustre-OST0001 00000001:00080000:1.0:1789635236.660549:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:1.0:1789635236.660570:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1789635236.660576:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1789635236.660587:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789635236.660592:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1789635236.660788:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635236.660812:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422004608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789635236.660890:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635236.660943:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004608 00000100:00100000:2.0:1789635236.661094:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004608 00000100:00100000:2.0:1789635236.661175:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635236.661186:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422004608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789635236.661229:0:8106:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789635236.661271:0:8106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aabaaa0, atime: 0x6aabaaa0, ctime: 0x6aabaaa0, blocks: 0x1 00010000:00010000:2.0:1789635236.661280:0:8106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635236.661298:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=212s v=(0 0) 00010000:00010000:2.0:1789635236.661303:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635236.661351:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635236.661371:0:8106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635236.661382:0:8106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635236.661401:0:8106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635236.661419:0:8106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789635236.661875:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789635236.661930:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635236.661938:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.661947:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635236.661952:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.661969:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.661990:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.662007:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cbdbd2/0x77332204cfbb2f79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635236.662027:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635236.662029:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635236.662031:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635236.662267:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422004608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1081us (1376us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789635236.662278:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000004:00080000:1.0:1789635236.662353:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79e71b0380/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789635236.662361:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422004608:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789635236.884884:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635237.396440:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789635237.651469:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635237.651493:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422004736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635237.651562:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635237.651601:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004736 00000100:00100000:0.0:1789635237.651611:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004736 00000100:00080000:3.0:1789635237.651664:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635237.651677:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789635237.651690:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422004736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635237.651727:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635237.651792:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422004736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635237.651800:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789635237.652524:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73ed80 x1876568422004736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635237.652544:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422004736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789635237.915299:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635238.933053:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635239.030909:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635239.031014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635239.031047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635239.031102:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635239.031243:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444032 00000100:00100000:1.0:1789635239.031256:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444032 00000100:00100000:1.0:1789635239.031335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 254 00000100:00100000:1.0:1789635239.031346:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410444032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635239.031597:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444288 00000100:00100000:3.0:1789635239.031602:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444288 00000100:00100000:3.0:1789635239.031657:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:3.0:1789635239.031666:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410444288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635239.031707:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410444288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635239.031714:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00080000:3.0:1789635239.031895:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635239.031987:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79cdf83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410444032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 642us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635239.031995:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 254 00000100:00100000:0.0:1789635239.032349:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444160 00000100:00100000:0.0:1789635239.032355:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444160 00000100:00100000:2.0:1789635239.032368:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444416 00000100:00100000:2.0:1789635239.032375:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444416 00000100:00080000:3.0:1789635239.032398:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635239.032409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:2.0:1789635239.032419:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1789635239.032423:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410444160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635239.032432:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410444416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635239.032474:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410444160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 56us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635239.032481:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:2.0:1789635239.033777:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410444416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1343us (2756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635239.033786:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1789635239.187682:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422005120:0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.187700:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422004992:0@lo:400:kworker.0 00000100:00100000:1.0:1789635239.187939:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422005248:0@lo:400:kworker.0 00000100:00100000:2.0:1789635239.188026:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422004864:0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.189260:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635239.189340:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422005504:0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.189524:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635239.189561:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635239.189568:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422005632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635239.189611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635239.189648:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004992 00000100:00100000:3.0:1789635239.189656:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004992 00000100:00100000:3.0:1789635239.189700:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422005504 00000100:00100000:3.0:1789635239.189703:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422005504 00000100:00100000:3.0:1789635239.189736:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789635239.189745:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422004992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635239.189756:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635239.189791:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422005120 00000100:00100000:0.0:1789635239.189796:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422005120 00000100:00100000:3.0:1789635239.189809:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422004992:12345-0@lo:400:kworker.0 Request processed in 64us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635239.189818:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789635239.189835:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789635239.189849:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422005504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635239.189883:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422005504:12345-0@lo:400:kworker.0 Request processed in 40us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635239.190097:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635239.190142:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422005248 00000100:00100000:1.0:1789635239.190159:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422005248 00000100:00100000:1.0:1789635239.190190:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789635239.190197:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422005248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635239.190233:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422005248:12345-0@lo:400:kworker.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635239.190239:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789635239.190275:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e71b3480 x1876568422005248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635239.190289:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422005248:0@lo:400:kworker.0 00000100:00100000:2.0:1789635239.190429:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635239.190464:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422005376:0@lo:400:kworker.0 00000100:00100000:2.0:1789635239.190487:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635239.190514:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422005632 00000100:00100000:2.0:1789635239.190518:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422005632 00000100:00100000:2.0:1789635239.190545:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635239.190738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789635239.190748:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422005120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.190790:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422005120:12345-0@lo:400:kworker.0 Request processed in 44us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635239.190796:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789635239.190819:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422004864 00000100:00100000:3.0:1789635239.190823:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422004864 00000100:00100000:3.0:1789635239.190847:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789635239.190853:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422004864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.190891:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c2dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422004864:12345-0@lo:400:kworker.0 Request processed in 38us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635239.190898:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789635239.190934:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422004992:0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.190944:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422005504:0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.191519:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422005376 00000100:00100000:3.0:1789635239.191524:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422005376 00000100:00100000:3.0:1789635239.191560:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789635239.191567:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568422005376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.191600:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568422005376:12345-0@lo:400:kworker.0 Request processed in 33us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635239.191606:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789635239.191636:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422004864:0@lo:400:kworker.0 00000100:00100000:3.0:1789635239.191646:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422005376:0@lo:400:kworker.0 00000100:00080000:3.0:1789635239.191690:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635239.191694:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635239.191697:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635239.191858:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422005632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635239.191890:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635239.191926:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422005632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1374us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635239.191933:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635239.192253:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422005632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635239.192290:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422005120:0@lo:400:kworker.0 00000100:00100000:0.0:1789635239.194129:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1789635239.955440:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635240.979732:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789635241.786607:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1789635242.005433:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635242.772344:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422005760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635242.772406:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635242.772459:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422005760 00000100:00100000:0.0:1789635242.772469:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422005760 00000100:00080000:1.0:1789635242.772504:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635242.772532:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789635242.772543:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422005760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635242.772579:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635242.772684:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422005760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635242.772691:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789635242.772773:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73fb80 x1876568422005760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635242.772791:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422005760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789635243.027970:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635244.052127:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635244.143040:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635244.143123:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635244.143289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444672 00000100:00100000:0.0:1789635244.143302:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444672 00000100:00100000:0.0:1789635244.143430:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1789635244.143444:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410444672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635244.143545:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410444672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 104us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635244.143553:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:1.0:1789635244.143852:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444544 00000100:00100000:1.0:1789635244.143858:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444544 00000100:00100000:1.0:1789635244.143903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 256 00000100:00100000:1.0:1789635244.143911:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2350:x1876568410444544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635244.143946:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2350:x1876568410444544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635244.143953:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 256 00000100:00080000:3.0:1789635244.144219:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635244.145617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635244.145658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635244.145735:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444800 00000100:00100000:1.0:1789635244.145744:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444800 00000100:00100000:1.0:1789635244.145806:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:1.0:1789635244.145816:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410444800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:3.0:1789635244.146040:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635244.146080:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410444800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 56us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635244.146088:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:0.0:1789635244.146205:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410444928 00000100:00100000:0.0:1789635244.146210:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410444928 00000100:00100000:0.0:1789635244.146257:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:0.0:1789635244.146265:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410444928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635244.146306:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410444928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (695us total) trans 0 rc 0/0 00000100:00080000:3.0:1789635244.146647:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635244.146999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:0.0:1789635244.309717:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635244.309741:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422005888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635244.309828:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635244.309973:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422005888 00000100:00100000:2.0:1789635244.309982:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422005888 00000100:00100000:2.0:1789635244.310048:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789635244.310135:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422005888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635244.310179:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635244.310248:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422005888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635244.310257:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789635244.310477:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422006400:0@lo:400:kworker.0 00000100:00100000:3.0:1789635244.310514:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635244.310548:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635244.310553:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422006272:0@lo:400:kworker.0 00000100:00100000:3.0:1789635244.310580:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635244.310676:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422006016:0@lo:400:kworker.0 00000100:00100000:3.0:1789635244.310725:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635244.310747:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422006528:0@lo:400:kworker.0 00000100:00100000:3.0:1789635244.310766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789635244.310815:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635244.310847:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789635244.310854:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79e71b0380, transno 4294967300 00000100:00100000:0.0:1789635244.310875:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422005888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635244.311296:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422006144:0@lo:400:kworker.0 00000100:00100000:2.0:1789635244.314208:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006400 00000100:00100000:2.0:1789635244.314229:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006400 00000100:00100000:2.0:1789635244.314372:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635244.314386:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422006400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635244.314495:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422006400:12345-0@lo:400:kworker.0 Request processed in 112us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635244.314503:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789635244.314563:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb0a80 x1876568422006400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635244.314596:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422006400:0@lo:400:kworker.0 00000100:00100000:2.0:1789635244.314642:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006016 00000100:00100000:2.0:1789635244.314646:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006016 00000100:00100000:2.0:1789635244.314671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789635244.314676:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422006016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635244.314702:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422006016:12345-0@lo:400:kworker.0 Request processed in 27us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635244.314706:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:0.0:1789635244.315094:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635244.315307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006272 00000100:00100000:1.0:1789635244.315329:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006272 00000100:00100000:1.0:1789635244.315373:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006528 00000100:00100000:1.0:1789635244.315376:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006528 00000100:00100000:1.0:1789635244.315401:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789635244.315409:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422006272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635244.315513:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635244.315569:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006144 00000100:00100000:0.0:1789635244.315573:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006144 00000100:00100000:0.0:1789635244.315594:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635244.315601:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422006528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635244.315636:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422006528:12345-0@lo:400:kworker.0 Request processed in 36us (4868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635244.315642:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635244.315656:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789635244.315662:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422006144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635244.315694:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422006144:12345-0@lo:400:kworker.0 Request processed in 32us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635244.315699:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789635244.315715:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635244.315736:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422006144:0@lo:400:kworker.0 00000100:00100000:1.0:1789635244.315891:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422006272:12345-0@lo:400:kworker.0 Request processed in 482us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635244.315898:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789635244.315974:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422006272:0@lo:400:kworker.0 00000100:00100000:3.0:1789635244.316041:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422006528:0@lo:400:kworker.0 00000100:00100000:3.0:1789635244.316076:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422006016:0@lo:400:kworker.0 00010000:00010000:3.0:1789635245.076033:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635246.099450:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635247.123591:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635247.636530:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789635247.892524:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422006656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635247.892603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635247.893025:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006656 00000100:00100000:1.0:1789635247.893034:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006656 00000100:00100000:1.0:1789635247.893098:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789635247.893109:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422006656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635247.893145:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635247.893204:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422006656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635247.893211:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789635247.893607:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73c380 x1876568422006656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635247.893635:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422006656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789635247.894105:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789635248.151352:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635249.171627:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635249.262579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635249.262620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635249.262647:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635249.262681:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635249.262990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445056 00000100:00100000:1.0:1789635249.263001:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445056 00000100:00100000:1.0:1789635249.263061:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 258 00000100:00100000:1.0:1789635249.263085:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2350:x1876568410445056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635249.263159:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2350:x1876568410445056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635249.263179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 258 00000100:00100000:0.0:1789635249.263913:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445184 00000100:00100000:0.0:1789635249.263920:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445184 00000100:00080000:3.0:1789635249.263988:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635249.263990:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445440 00000100:00100000:0.0:1789635249.263994:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445440 00000100:00100000:0.0:1789635249.264021:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1789635249.264028:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410445184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635249.264069:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445312 00000100:00100000:2.0:1789635249.264074:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445312 00000100:00100000:0.0:1789635249.264086:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410445184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635249.264104:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:2.0:1789635249.264116:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410445312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635249.264149:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410445312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635249.264155:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00080000:2.0:1789635249.265210:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635249.265216:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635249.268767:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1789635249.268844:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410445440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635249.269279:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410445440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 98us (6249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635249.269289:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1789635249.271149:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1789635249.428106:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422007040:0@lo:400:kworker.0 00000100:00100000:3.0:1789635249.428177:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635249.428258:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635249.428265:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422007168:0@lo:400:kworker.0 00000100:00100000:3.0:1789635249.428294:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635249.428348:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007168 00000100:00100000:3.0:1789635249.428356:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007168 00000100:00100000:1.0:1789635249.428674:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007040 00000100:00100000:1.0:1789635249.428679:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007040 00000100:00100000:1.0:1789635249.428728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789635249.428738:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422007040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635249.428865:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422007040:12345-0@lo:400:kworker.0 Request processed in 128us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635249.428872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789635249.429034:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422006912:0@lo:400:kworker.0 00000100:00100000:2.0:1789635249.429065:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635249.429087:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422007424:0@lo:400:kworker.0 00000100:00100000:2.0:1789635249.429108:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635249.429142:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789635249.429148:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422006784:0@lo:400:kworker.0 00000100:00100000:3.0:1789635249.429269:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789635249.429276:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422007168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635249.429331:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422007168:12345-0@lo:400:kworker.0 Request processed in 36us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635249.429338:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789635249.429364:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635249.429368:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635249.429377:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006912 00000100:00100000:3.0:1789635249.429381:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006912 00000100:00100000:3.0:1789635249.429401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007424 00000100:00100000:3.0:1789635249.429405:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007424 00000100:00100000:3.0:1789635249.429425:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789635249.429431:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422006912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635249.429593:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422007040:0@lo:400:kworker.0 00010000:00080000:1.0:1789635249.429621:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7ecad80 x1876568422007168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635249.429632:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422007168:0@lo:400:kworker.0 00000100:00100000:1.0:1789635249.429666:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789635249.429674:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422007424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635249.430625:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635249.430697:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422006912:12345-0@lo:400:kworker.0 Request processed in 1264us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635249.430705:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789635249.430726:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635249.430747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422006784 00000100:00100000:3.0:1789635249.430754:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422006784 00000100:00100000:3.0:1789635249.430794:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789635249.430802:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422006784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635249.430950:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635249.430973:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422007552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635249.435791:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422007424:12345-0@lo:400:kworker.0 Request processed in 6097us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635249.435807:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789635249.436471:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422007296:0@lo:400:kworker.0 00000100:00100000:2.0:1789635249.436519:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635249.436563:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422006912:0@lo:400:kworker.0 00000100:00100000:2.0:1789635249.436575:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422007424:0@lo:400:kworker.0 00000100:00100000:1.0:1789635249.436956:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007296 00000100:00100000:1.0:1789635249.436975:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007296 00000100:00100000:1.0:1789635249.437035:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789635249.437044:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422007296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635249.437112:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422007296:12345-0@lo:400:kworker.0 Request processed in 69us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635249.437119:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789635249.437338:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635249.437359:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422007296:0@lo:400:kworker.0 00000100:00100000:3.0:1789635249.443869:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422006784:12345-0@lo:400:kworker.0 Request processed in 13058us (14681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635249.443885:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789635249.445514:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635249.448843:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422006784:0@lo:400:kworker.0 00000100:00100000:1.0:1789635249.449083:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007552 00000100:00100000:1.0:1789635249.449091:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007552 00000100:00100000:1.0:1789635249.449147:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789635249.449156:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422007552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635249.449203:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635249.449490:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422007552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 335us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635249.449498:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635249.452086:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422007552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789635250.195464:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635251.220212:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635252.245187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635253.011675:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422007680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635253.011745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635253.011864:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007680 00000100:00100000:1.0:1789635253.011873:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007680 00000100:00080000:3.0:1789635253.011937:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635253.011940:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789635253.011949:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422007680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635253.011983:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635253.012026:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422007680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635253.012033:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789635253.012045:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73c380 x1876568422007680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635253.012063:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422007680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789635253.267571:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635254.291474:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635254.548580:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422007808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635254.548657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635254.576237:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007808 00000100:00100000:1.0:1789635254.576250:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007808 00000100:00100000:0.0:1789635254.576331:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422008320:0@lo:400:kworker.0 00000100:00100000:0.0:1789635254.576395:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635254.576452:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789635254.576459:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422007936:0@lo:400:kworker.0 00000100:00100000:0.0:1789635254.576501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635254.576502:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789635254.576516:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422007808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635254.576527:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422008448:0@lo:400:kworker.0 00000100:00100000:0.0:1789635254.576552:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635254.576575:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422008192:0@lo:400:kworker.0 00000100:00100000:0.0:1789635254.576596:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635254.576612:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635254.576617:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422008064:0@lo:400:kworker.0 00000100:00080000:2.0:1789635254.576747:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635254.576774:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422007936 00000100:00100000:2.0:1789635254.576778:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422007936 00000100:00100000:2.0:1789635254.576806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789635254.576814:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422007936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635254.576912:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422007936:12345-0@lo:400:kworker.0 Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635254.576919:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789635254.577209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635254.577256:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422007936:0@lo:400:kworker.0 00000100:00100000:2.0:1789635254.577431:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008448 00000100:00100000:2.0:1789635254.577436:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008448 00000100:00100000:2.0:1789635254.577482:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008192 00000100:00100000:2.0:1789635254.577490:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008192 00000100:00100000:2.0:1789635254.577504:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008064 00000100:00100000:2.0:1789635254.577506:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008064 00000100:00100000:2.0:1789635254.577517:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789635254.577523:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568422008448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635254.577556:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568422008448:12345-0@lo:400:kworker.0 Request processed in 33us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635254.577562:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789635254.577573:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789635254.577578:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422008192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635254.577602:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422008192:12345-0@lo:400:kworker.0 Request processed in 24us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635254.577608:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789635254.577618:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00002000:00000024:1.0:1789635254.577645:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635254.577688:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422007808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1175us (29030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635254.577705:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789635254.577745:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422008064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635254.577776:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422008064:12345-0@lo:400:kworker.0 Request processed in 152us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635254.577782:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789635254.578138:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008320 00000100:00100000:3.0:1789635254.578143:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008320 00000100:00100000:3.0:1789635254.578181:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789635254.578187:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422008320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635254.578222:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422008320:12345-0@lo:400:kworker.0 Request processed in 36us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635254.578228:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789635254.578419:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635254.578441:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422008448:0@lo:400:kworker.0 00010000:00080000:0.0:1789635254.578455:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73f100 x1876568422008320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635254.578478:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422008320:0@lo:400:kworker.0 00000100:00100000:0.0:1789635254.578501:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422007808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635254.578520:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422008064:0@lo:400:kworker.0 00000100:00100000:1.0:1789635254.578549:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422008192:0@lo:400:kworker.0 00000100:00100000:3.0:1789635254.629128:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635254.629168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635254.629205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635254.629238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635254.629266:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445696 00000100:00100000:3.0:1789635254.629276:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445696 00000100:00100000:3.0:1789635254.629365:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445952 00000100:00100000:3.0:1789635254.629368:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445952 00000100:00100000:3.0:1789635254.629388:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:3.0:1789635254.629397:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410445696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635254.629563:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445568 00000100:00100000:1.0:1789635254.629567:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445568 00000100:00100000:2.0:1789635254.629635:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:2.0:1789635254.629644:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2350:x1876568410445952:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635254.630150:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410445696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 751us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635254.630160:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00080000:0.0:1789635254.639018:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635254.639069:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410445824 00000100:00100000:0.0:1789635254.639080:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410445824 00000100:00100000:0.0:1789635254.639406:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789635254.639417:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2347:x1876568410445824:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1789635254.639446:0:8106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2eb5 00000100:00080000:0.0:1789635254.639454:0:8106:0:(import.c:65:import_set_state_nolock()) ffff9e79c7345000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635254.639490:0:8106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789635254.639810:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 261 00000100:00100000:1.0:1789635254.639822:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2350:x1876568410445568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635254.640188:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2350:x1876568410445952:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 10542us (10946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635254.640198:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1789635254.650913:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2350:x1876568410445568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11076us (21776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635254.650930:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 261 00000100:00080000:1.0:1789635254.651003:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789635254.651018:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635254.660121:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+2:2347:x1876568410445824:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 20690us (30899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635254.660138:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00010000:00010000:0.0:1789635255.318177:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635256.340093:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789635257.206858:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:1.0:1789635257.206868:0:7663:0:(genops.c:885:class_export_put()) final put ffff9e79c7346000/e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:3.0:1789635257.207423:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c7346000/e05ee327-d920-4885-acb2-a26d789e134c for lustre-OST0001 00000020:00000080:3.0:1789635257.207490:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79c7345000 for lustre-OST0001 00010000:00010000:0.0:1789635257.365644:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635257.876028:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789635258.131693:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422008576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635258.131772:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635258.132015:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008576 00000100:00100000:2.0:1789635258.132034:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008576 00000100:00100000:2.0:1789635258.132106:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789635258.132108:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635258.132129:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422008576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635258.132168:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635258.132225:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422008576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635258.132232:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789635258.132262:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73c700 x1876568422008576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635258.132281:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422008576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789635258.387698:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635259.411451:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635259.504210:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635259.504246:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635259.504284:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635259.504324:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410446336 00000100:00100000:3.0:1789635259.504334:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410446336 00000100:00100000:3.0:1789635259.504385:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410446208 00000100:00100000:3.0:1789635259.504388:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410446208 00000100:00100000:3.0:1789635259.504410:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789635259.504419:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410446336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635259.504486:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410446336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635259.504493:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789635259.504508:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:3.0:1789635259.504514:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410446208:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635259.504539:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410446208:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635259.504545:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:3.0:1789635259.509654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410446080 00000100:00100000:3.0:1789635259.509669:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410446080 00000100:00100000:3.0:1789635259.509727:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 262 00000100:00100000:3.0:1789635259.509737:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410446080:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635259.509932:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410446080:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 195us (5730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635259.509940:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 262 00000100:00080000:0.0:1789635259.590140:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789635259.666248:0:11852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:54:19 (1789635259) 00000100:00100000:2.0:1789635259.667551:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422008960:0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.667615:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635259.667664:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789635259.667670:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422008832:0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.667689:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635259.667704:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422009344:0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.667720:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635259.667763:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008960 00000100:00100000:2.0:1789635259.667771:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008960 00000100:00100000:2.0:1789635259.667825:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008832 00000100:00100000:2.0:1789635259.667829:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008832 00000100:00100000:2.0:1789635259.667842:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009344 00000100:00100000:2.0:1789635259.667844:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009344 00000100:00100000:2.0:1789635259.667861:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789635259.667869:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422008960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.667921:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422008960:12345-0@lo:400:kworker.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635259.667928:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789635259.667945:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789635259.667951:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422008832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.667978:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422008832:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635259.667993:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789635259.668006:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789635259.668011:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422009344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.668039:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422009344:12345-0@lo:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635259.668044:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789635259.668087:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422008832:0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.668098:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422009344:0@lo:400:kworker.0 00000100:00100000:2.0:1789635259.668106:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422008960:0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668364:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422009088:0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635259.668424:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789635259.668430:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422008704:0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635259.668476:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422009216:0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789635259.668521:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635259.668532:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009088 00000100:00100000:0.0:1789635259.668536:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009088 00000100:00100000:0.0:1789635259.668561:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009216 00000100:00100000:0.0:1789635259.668564:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009216 00000100:00100000:0.0:1789635259.668586:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789635259.668593:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422009088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668626:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422009088:12345-0@lo:400:kworker.0 Request processed in 34us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635259.668632:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789635259.668644:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789635259.668649:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422009216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668673:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422009216:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635259.668679:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789635259.668696:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422008704 00000100:00100000:0.0:1789635259.668700:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422008704 00000100:00100000:0.0:1789635259.668721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789635259.668727:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422008704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668767:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422008704:12345-0@lo:400:kworker.0 Request processed in 41us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635259.668849:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1789635259.668880:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635259.668899:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422008704:0@lo:400:kworker.0 00000100:00100000:0.0:1789635259.668910:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422009216:0@lo:400:kworker.0 00010000:00080000:0.0:1789635259.668921:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe73ed80 x1876568422009088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635259.668931:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422009088:0@lo:400:kworker.0 00000100:00100000:1.0:1789635259.669118:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422009472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635259.669148:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635259.669222:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009472 00000100:00100000:0.0:1789635259.669226:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009472 00000100:00100000:0.0:1789635259.669260:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635259.669279:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422009472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635259.669305:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635259.676853:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422009472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7576us (7693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635259.676869:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789635259.679885:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422009472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789635260.435707:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635261.460780:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635261.993637:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635261.993806:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410446464 00000100:00100000:2.0:1789635261.993817:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410446464 00000100:00100000:2.0:1789635261.993904:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1789635261.993919:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:10206:x1876568410446464:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635261.993939:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635261.995292:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb2f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d063 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.995386:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb2f87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.995398:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb2f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.995411:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb2f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635261.995462:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789635261.995465:0:7562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635261.995503:0:7562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb2f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.995527:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb2f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d063 expref: 7 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.995546:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb2f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d063 expref: 6 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635261.995555:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3400) 00010000:00010000:2.0:1789635261.995558:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635261.995561:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635261.995635:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:10206:x1876568410446464:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1721us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635261.995644:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00080000:0.0:1789635261.996209:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635262.000633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635262.000851:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410446592 00000100:00100000:2.0:1789635262.000873:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410446592 00000100:00100000:2.0:1789635262.000936:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:2.0:1789635262.000947:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:10207:x1876568410446592:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635262.000979:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635262.001002:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb2f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d06a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.001066:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.001094:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.001105:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.001122:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.001129:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.001136:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005155:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820400/0x77332204cfbb2fa3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005179:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820400/0x77332204cfbb2fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005190:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820400/0x77332204cfbb2fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635262.005222:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789635262.005226:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635262.005246:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820400/0x77332204cfbb2fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005257:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005279:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005285:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005292:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635262.005296:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005304:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005349:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3400) 00010000:00010000:2.0:1789635262.005354:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635262.005359:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005365:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005379:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005385:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.005391:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.006267:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635262.006284:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.006292:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.006303:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e79d91f3a00) 00010000:00010000:2.0:1789635262.006306:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635262.006309:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.006346:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2f9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.006395:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb2f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d06a expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.006419:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820400/0x77332204cfbb2fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d06a expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.006425:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e79d91f3900) 00010000:00010000:2.0:1789635262.006428:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635262.006430:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820400, rc 0) 00000100:00100000:2.0:1789635262.006508:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:10207:x1876568410446592:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 5561us (5885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635262.006517:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1789635262.030095:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635262.030217:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410446848 00000100:00100000:2.0:1789635262.030230:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410446848 00000100:00100000:2.0:1789635262.030302:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:2.0:1789635262.030353:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:10207:x1876568410446848:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635262.030393:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635262.030419:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb2faa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d071 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.030512:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.030530:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.030542:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.038634:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.038658:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635262.039574:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.040578:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2fbf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.040603:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2fbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.040617:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2fbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635262.040632:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789635262.043150:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043170:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043231:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043305:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635262.043330:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043340:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043359:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e79d91f3900) 00010000:00010000:3.0:1789635262.043362:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635262.043382:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043389:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb2fb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043407:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043414:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043420:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043425:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635262.043428:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043434:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043442:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e79d91f3a00) 00010000:00010000:3.0:1789635262.043445:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635262.043448:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.043455:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb2fb8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.048429:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb2faa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d071 expref: 10 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.048488:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2fbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d071 expref: 9 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635262.048498:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:3.0:1789635262.048501:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635262.048505:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72400, rc 0) 00000100:00100000:3.0:1789635262.052075:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:10207:x1876568410446848:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 21441us (21671us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789635262.052092:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635262.068973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635262.069214:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410446976 00000100:00100000:3.0:1789635262.069239:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410446976 00000100:00100000:3.0:1789635262.069349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1789635262.069361:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:10207:x1876568410446976:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789635262.069683:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:10207:x1876568410446976:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 323us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635262.069692:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000001:00080000:3.0:1789635262.316907:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1789635262.483794:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635262.997079:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789635263.254350:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635263.254374:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422009600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635263.254438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635263.254546:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009600 00000100:00100000:2.0:1789635263.254554:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009600 00000100:00100000:2.0:1789635263.254612:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635263.254621:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422009600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635263.254655:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635263.254696:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422009600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635263.254703:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789635263.263649:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789635263.263729:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dbcb1500 x1876568422009600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635263.263755:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422009600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789635263.507457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635264.533155:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635264.601370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635264.601408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410447104 00000100:00100000:3.0:1789635264.601420:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410447104 00000100:00100000:3.0:1789635264.601485:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789635264.601507:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:10250:x1876568410447104:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635264.601530:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635264.601551:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2fcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d078 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601617:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601632:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601642:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601657:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601664:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601671:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601878:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601896:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601902:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601908:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635264.601913:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601932:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601945:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3400) 00010000:00010000:3.0:1789635264.601948:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635264.601953:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601958:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb2fd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601970:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601975:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601980:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601985:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635264.601993:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.601999:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.602006:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e79d91ba000) 00010000:00010000:3.0:1789635264.602009:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635264.602012:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.602018:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb2fdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.602048:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2fcd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d078 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.602058:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3400) 00010000:00010000:3.0:1789635264.602060:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635264.602063:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb2fcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d078 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635264.602072:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:3.0:1789635264.602126:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:10250:x1876568410447104:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 632us (766us total) trans 0 rc 301/301 00000100:00100000:3.0:1789635264.602133:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00080000:3.0:1789635264.602156:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635264.606958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635264.607031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410447360 00000100:00100000:0.0:1789635264.607041:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410447360 00000100:00100000:0.0:1789635264.607102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:0.0:1789635264.607112:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:10250:x1876568410447360:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:0.0:1789635264.607171:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635264.607197:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb2f87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d063 expref: 8 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.607245:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3400) 00010000:00010000:0.0:1789635264.607257:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635264.607492:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.607914:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.607926:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.607941:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.607948:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.607955:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635264.610567:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789635264.610585:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.610595:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.610602:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.610609:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635264.610614:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.610622:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.610638:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:2.0:1789635264.610642:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635264.610646:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.610652:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb2fe2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635264.610669:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039582e43 reply state 00000000a0087d12 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635264.610677:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635264.610806:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:10250:x1876568410447360:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 3692us (3856us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789635264.610814:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00010000:00010000:1.0:1789635264.627641:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.627673:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.627681:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.627687:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635264.627700:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.627709:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.627727:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e79d088e400) 00010000:00010000:1.0:1789635264.627731:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635264.627736:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.627744:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb2fe9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635264.630668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635264.630766:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635264.630799:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410447616 00000100:00100000:1.0:1789635264.630809:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410447616 00000100:00100000:1.0:1789635264.630871:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:1.0:1789635264.630881:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410447616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635264.630970:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410447616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 90us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635264.630987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00080000:1.0:1789635264.631010:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635264.631358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410447488 00000100:00100000:0.0:1789635264.631363:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410447488 00000100:00100000:0.0:1789635264.631398:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 264 00000100:00100000:0.0:1789635264.631407:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410447488:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635264.631443:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410447488:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.631450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 264 00000100:00100000:2.0:1789635264.702343:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.702383:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410447744 00000100:00100000:2.0:1789635264.702393:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410447744 00000100:00100000:2.0:1789635264.702441:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1789635264.702452:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:10258:x1876568410447744:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:2.0:1789635264.702475:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635264.703088:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d07f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.703159:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb2ff7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.703173:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb2ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.703185:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb2ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635264.703230:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789635264.703234:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635264.703275:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb2ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.703299:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb2ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d07f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.703451:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb2ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d07f expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.703461:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635264.703470:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635264.703474:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820600, rc 0) 00000100:00100000:2.0:1789635264.703728:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+9:10258:x1876568410447744:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 1277us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.703736:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:0.0:1789635264.769583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635264.769710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410447872 00000100:00100000:1.0:1789635264.769721:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410447872 00000100:00100000:1.0:1789635264.769786:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:1.0:1789635264.769797:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:10264:x1876568410447872:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789635264.769818:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635264.769838:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb2ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d086 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.769902:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.769916:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.769927:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.769941:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.769948:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.769955:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770050:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174600/0x77332204cfbb3013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770068:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174600/0x77332204cfbb3013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770076:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174600/0x77332204cfbb3013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635264.770104:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789635264.770108:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635264.770144:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174600/0x77332204cfbb3013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770158:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770164:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770172:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770178:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635264.770182:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770188:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770200:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:1.0:1789635264.770203:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635264.770208:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770224:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770238:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770244:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770249:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770254:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635264.770256:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770262:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770270:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e79d898a400) 00010000:00010000:1.0:1789635264.770273:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635264.770275:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770281:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb300c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770349:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb2ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d086 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770365:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174600/0x77332204cfbb3013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d086 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.770379:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:1.0:1789635264.770381:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789635264.770384:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02174600, rc 0) 00000100:00100000:1.0:1789635264.770610:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+10:10264:x1876568410447872:12345-192.168.201.30@tcp:101:bash.0 Request processed in 814us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635264.770619:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:3.0:1789635264.774856:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.774964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410448128 00000100:00100000:2.0:1789635264.774977:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410448128 00000100:00100000:2.0:1789635264.775080:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789635264.775090:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+10:10264:x1876568410448128:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789635264.775110:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635264.775128:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb301a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d08d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.775655:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.775670:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.775681:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.777286:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.777306:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.777371:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635264.778156:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789635264.779046:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779062:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779073:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779111:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779118:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779126:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779131:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635264.779135:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779143:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779155:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635264.779158:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635264.779163:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779168:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3021 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635264.779193:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b23ff9d reply state 00000000127c29cb transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635264.779200:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789635264.779675:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb301a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779703:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.779711:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:0.0:1789635264.779714:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635264.779716:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030e00, rc 0) 00000100:00100000:0.0:1789635264.779797:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+13:10264:x1876568410448128:12345-192.168.201.30@tcp:101:bash.0 Request processed in 4709us (4952us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789635264.779807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00010000:00010000:1.0:1789635264.781457:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.781471:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.781479:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.781485:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635264.781489:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.781497:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.781513:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3300) 00010000:00010000:1.0:1789635264.781516:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635264.781519:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.781525:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635264.784915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635264.785437:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410448256 00000100:00100000:0.0:1789635264.785449:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410448256 00000100:00100000:0.0:1789635264.785498:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1789635264.785507:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1876568410448256:12345-192.168.201.30@tcp:8:bash.0 00010000:00080000:0.0:1789635264.785539:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1789635264.785570:0:6691:0:(genops.c:1384:class_connect()) connect: client e05ee327-d920-4885-acb2-a26d789e134c, cookie 0x77332204cfbb303d 00002000:00100000:0.0:1789635264.785581:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e05ee327-d920-4885-acb2-a26d789e134c/ffff9e79fe5f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635264.785598:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635264.785845:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789635264.785888:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5f7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635264.785951:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2347:x1876568410448256:12345-192.168.201.30@tcp:8:bash.0 Request processed in 442us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.785959:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789635264.788534:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422010112:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.788567:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422009856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635264.788599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635264.788599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635264.788663:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009856 00000100:00100000:2.0:1789635264.788670:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009856 00000100:00100000:2.0:1789635264.788739:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789635264.788750:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422009856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635264.788783:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635264.788825:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422009856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.788831:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789635264.788857:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422010112 00000100:00100000:2.0:1789635264.788861:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422010112 00000100:00100000:2.0:1789635264.788889:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789635264.788895:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422010112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789635264.788898:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635264.788902:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635264.788928:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422010112:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.788934:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789635264.788976:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422009984:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789003:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635264.789012:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422010112:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789020:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422010496:0@lo:400:kworker.0 00000100:00100000:1.0:1789635264.789031:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789635264.789037:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422009728:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789038:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635264.789061:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635264.789066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009984 00000100:00100000:0.0:1789635264.789069:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009984 00000100:00100000:1.0:1789635264.789080:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422010240:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789089:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422010496 00000100:00100000:0.0:1789635264.789091:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422010496 00000100:00100000:1.0:1789635264.789102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635264.789108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789635264.789113:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422009984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635264.789128:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789635264.789135:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422010496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789145:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422009984:12345-0@lo:400:kworker.0 Request processed in 31us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.789150:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789635264.789159:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422010496:12345-0@lo:400:kworker.0 Request processed in 26us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635264.789165:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789635264.789169:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422009728 00000100:00100000:0.0:1789635264.789172:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422009728 00000100:00100000:0.0:1789635264.789204:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789635264.789211:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422009728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635264.789224:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422009856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635264.789230:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422010368:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789245:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422009728:12345-0@lo:400:kworker.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.789250:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635264.789261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789635264.789286:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422010240 00000100:00100000:0.0:1789635264.789290:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422010240 00000100:00100000:0.0:1789635264.789355:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422010368 00000100:00100000:0.0:1789635264.789358:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422010368 00000100:00100000:0.0:1789635264.789386:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635264.789393:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789635264.789393:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422010240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635264.789399:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422010368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789425:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422010240:12345-0@lo:400:kworker.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.789426:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422010368:12345-0@lo:400:kworker.0 Request processed in 28us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.789430:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635264.789433:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789635264.789447:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635264.789453:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422010368:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789459:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422009984:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789467:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422010496:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789565:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422009728:0@lo:400:kworker.0 00010000:00080000:0.0:1789635264.789578:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e78c1d47480 x1876568422010240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789635280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635264.789588:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422010240:0@lo:400:kworker.0 00000100:00100000:0.0:1789635264.789919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.790248:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410448384 00000100:00100000:2.0:1789635264.790254:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410448384 00000100:00100000:2.0:1789635264.790349:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1789635264.790357:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:0:x1876568410448384:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789635264.790369:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635264.790394:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d094 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635264.790418:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789635264.790433:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=240s v=(0 0) 00010000:00010000:2.0:1789635264.790438:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635264.790447:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.790468:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.790481:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635264.790530:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:0:x1876568410448384:12345-192.168.201.30@tcp:101:bash.0 Request processed in 175us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.790537:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00080000:0.0:1789635264.790862:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635264.793027:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635264.793300:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410448512 00000100:00100000:0.0:1789635264.793373:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410448512 00000100:00100000:0.0:1789635264.793457:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1789635264.793467:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:10264:x1876568410448512:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635264.793483:0:8106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635264.793515:0:8106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d09b expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.793543:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.793553:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635264.793557:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635264.793563:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.793598:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.793611:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 8 pid: 6694 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635264.793623:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422010624:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635264.793715:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024300 going to sleep for 11 seconds 00000100:00100000:0.0:1789635264.798979:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422010624:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635264.798988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1789635264.799020:0:8106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.799041:0:8106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:2.0:1789635264.799158:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410448640 00000100:00100000:2.0:1789635264.799165:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410448640 00010000:00010000:2.0:1789635264.799200:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 9 pid: 6694 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635264.799253:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:2.0:1789635264.799263:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410448640:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635264.799277:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635264.799300:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 9 pid: 6694 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.799343:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 9 pid: 6694 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.799366:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3044 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d094 expref: 9 pid: 6694 timeout: 340 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.799380:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635264.799385:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635264.799392:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.799401:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.799434:0:6707:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635264.799448:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6707:1876568422010752:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789635264.799567:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:10264:x1876568410448512:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6101us (6545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.799584:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:2.0:1789635264.799712:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7c1e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635264.803026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635264.803071:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6707:1876568422010752:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789635264.803094:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635264.803141:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410448896 00000100:00100000:3.0:1789635264.803149:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410448640:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3888us (4161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.803149:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410448896 00000100:00100000:3.0:1789635264.803157:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:0.0:1789635264.803231:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1789635264.803241:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+12:10264:x1876568410448896:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:0.0:1789635264.803581:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+13:10264:x1876568410448896:12345-192.168.201.30@tcp:35:bash.0 Request processed in 342us (565us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789635264.803588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1789635264.874988:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635264.875343:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410449152 00000100:00100000:0.0:1789635264.875354:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410449152 00000100:00100000:0.0:1789635264.875417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:0.0:1789635264.875428:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:10274:x1876568410449152:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635264.875453:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635264.875475:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0a2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635264.875581:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789635264.875713:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3052 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0a2 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.875728:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:0.0:1789635264.875732:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635264.875737:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0a2 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.875752:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030200, rc 0) 00000100:00100000:0.0:1789635264.875833:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+14:10274:x1876568410449152:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 406us (853us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789635264.875840:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1789635264.883987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.884085:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410449408 00000100:00100000:2.0:1789635264.884096:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410449408 00000100:00100000:2.0:1789635264.884163:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789635264.884174:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+14:10274:x1876568410449408:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635264.884441:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:10274:x1876568410449408:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 269us (463us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789635264.884449:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789635264.956969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635264.957086:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410449536 00000100:00100000:0.0:1789635264.957098:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410449536 00000100:00100000:0.0:1789635264.957165:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:0.0:1789635264.957176:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+15:10280:x1876568410449536:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635264.957203:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635264.957234:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0a9 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.957305:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3067 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.957355:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.957366:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635264.957402:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789635264.957405:0:7562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635264.957422:0:7562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.957448:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0a9 expref: 17 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.957466:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0a9 expref: 16 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.957505:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635264.957509:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635264.957512:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031400, rc 0) 00000100:00100000:0.0:1789635264.957573:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+16:10280:x1876568410449536:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 398us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635264.957579:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:1.0:1789635264.963618:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.963725:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410449792 00000100:00100000:2.0:1789635264.963737:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410449792 00000100:00100000:2.0:1789635264.963797:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789635264.963808:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+16:10280:x1876568410449792:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635264.963829:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635264.963848:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb306e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0b0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.963966:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.963981:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.963992:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635264.964005:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789635264.964161:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb306e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0b0 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.964180:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0b0 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.964188:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:2.0:1789635264.964191:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635264.964194:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635264.964259:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:10280:x1876568410449792:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 453us (651us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789635264.964266:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:1.0:1789635264.968371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635264.968512:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410450048 00000100:00100000:0.0:1789635264.968523:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410450048 00000100:00100000:0.0:1789635264.968582:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:0.0:1789635264.968592:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+18:10280:x1876568410450048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635264.968617:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635264.968637:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0b7 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.968743:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb308a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.968758:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb308a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.968770:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb308a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635264.968784:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789635264.968913:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0b7 expref: 21 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.968952:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb308a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0b7 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635264.968961:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:0.0:1789635264.968965:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789635264.968967:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030a00, rc 0) 00000100:00100000:0.0:1789635264.969030:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+20:10280:x1876568410450048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 439us (670us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789635264.969037:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789635264.972091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.972179:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410450176 00000100:00100000:2.0:1789635264.972189:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410450176 00000100:00100000:2.0:1789635264.972256:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789635264.972266:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:2348:x1876568410450176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635264.972279:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635264.972303:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0b0 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.972352:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:2.0:1789635264.972358:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635264.972416:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:2348:x1876568410450176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 151us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635264.972424:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1789635264.977269:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.977383:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410450304 00000100:00100000:2.0:1789635264.977395:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410450304 00000100:00100000:2.0:1789635264.977467:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1789635264.977478:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410450304:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:2.0:1789635264.977534:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.977554:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.977563:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635264.977567:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635264.977571:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.977607:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635264.977622:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 7 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635264.977637:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1876568422010880:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635264.977742:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7c1e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635264.982192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635264.982553:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1876568422010880:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635264.982581:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635264.982864:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410450432 00000100:00100000:1.0:1789635264.982873:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410450432 00002000:00100000:1.0:1789635264.982934:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9e79c7b5d180 x1876568410450432/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:640/0 lens 504/0 e 0 to 0 dl 1789635275 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789635264.982944:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79c7b5d180 with x1876568410450432 ext(0->12) 00010000:00010000:1.0:1789635264.982952:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 8 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635264.982977:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 8 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635264.982986:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79c7b5d180 00000100:00100000:1.0:1789635264.983024:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1789635264.983035:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410450432:12345-192.168.201.30@tcp:4:lfs.0 00000001:00100000:3.0:1789635265.013307:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000100:00100000:0.0:1789635265.014154:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410450432:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 31112us (31964us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789635265.014171:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00002000:00100000:0.0:1789635265.014186:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9e79c7b5d180 x1876568410450432/t4294967299(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:640/0 lens 504/448 e 0 to 0 dl 1789635275 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635265.014196:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79c7b5d180 with x1876568410450432 ext(0->12) 00010000:00010000:0.0:1789635265.014208:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 9 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.014227:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 9 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635265.014235:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79c7b5d180 00000100:00100000:2.0:1789635265.017022:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635265.017123:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410450560 00000100:00100000:3.0:1789635265.017133:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410450560 00010000:00010000:3.0:1789635265.017181:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 9 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635265.017363:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1789635265.017377:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:2351:x1876568410450560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635265.017393:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789635265.017671:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789635265.017676:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789635266 00002000:00010000:3.0:1789635265.017678:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789635266 00002000:00010000:3.0:1789635265.017680:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789635266 00010000:00010000:3.0:1789635265.017697:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 9 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.017713:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 9 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.017754:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb304b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d09b expref: 9 pid: 8106 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.017771:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635265.017775:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635265.017780:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.017790:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635265.017869:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635265.017939:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:2351:x1876568410450560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 565us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635265.017947:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00010000:00010000:0.0:1789635265.019414:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019455:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019548:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019556:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019565:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019572:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635265.019576:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019585:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019605:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.019612:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb3098 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.019731:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410450304:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 42251us (42470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635265.019740:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1789635265.027705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635265.027799:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410450816 00000100:00100000:0.0:1789635265.027811:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410450816 00000100:00100000:0.0:1789635265.027915:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1789635265.027926:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:10280:x1876568410450816:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:0.0:1789635265.027993:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb308a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0b7 expref: 19 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635265.028287:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789635265.028371:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789635265.029093:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789635265.029152:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.029168:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.029178:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.029212:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.029227:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 23 pid: 5843 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.029254:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876568422011008:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635265.029599:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635265.033143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635265.033245:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410450944 00000100:00100000:2.0:1789635265.033255:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410450944 00010000:00010000:2.0:1789635265.033294:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 24 pid: 5843 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635265.033397:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1789635265.033407:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:2348:x1876568410450944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635265.033421:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635265.033428:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 24 pid: 5843 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.033441:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 24 pid: 5843 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.033461:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:2.0:1789635265.033466:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.033475:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.033484:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.033514:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635265.033566:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:2348:x1876568410450944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 161us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635265.033574:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00010000:00010000:0.0:1789635265.033673:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb302f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d08d expref: 23 pid: 5843 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.033704:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876568422011008:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635265.033725:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.033734:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.033740:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635265.033862:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789635265.034064:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789635265.034170:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422011136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635265.034260:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635265.034287:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635265.034337:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422011136 00000100:00100000:0.0:1789635265.034342:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422011136 00000100:00100000:0.0:1789635265.034380:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635265.034386:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422011136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635265.034450:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422011136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635265.034467:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789635265.034488:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635265.034510:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422011136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789635265.035168:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789635265.035235:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422011264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635265.035269:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635265.035307:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422011264 00000100:00100000:0.0:1789635265.035336:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422011264 00000100:00100000:0.0:1789635265.035372:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635265.035380:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422011264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635265.035557:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876568422011264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 177us (287us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789635265.035565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635265.035586:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635265.035604:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7183100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422011264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789635265.035641:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1789635265.035672:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.035681:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.035701:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.035707:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635265.035711:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.035726:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.035743:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:0.0:1789635265.035746:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789635265.035751:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.035757:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb309f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635265.035921:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789635265.036121:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789635265.036132:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240855820363ns, next at 241855818353ns, rc = 0 00000001:00080000:0.0:1789635265.036139:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789635265.036169:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:0.0:1789635265.036172:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789635265.036180:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb308a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0b7 expref: 27 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.036260:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+26:10280:x1876568410450816:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 8335us (8575us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789635265.036267:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000020:00080000:0.0:1789635265.036271:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789635265.039006:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635265.039346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410451072 00000100:00100000:2.0:1789635265.039356:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410451072 00000100:00100000:2.0:1789635265.039403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:2.0:1789635265.039411:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:10280:x1876568410451072:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635265.039435:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635265.039456:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb30a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0be expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.039614:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb30a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0be expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.039629:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb30a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0be expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.039647:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:2.0:1789635265.039650:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635265.039653:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635265.039813:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+27:10280:x1876568410451072:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 399us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635265.039820:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:2.0:1789635265.042897:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635265.043062:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410451328 00000100:00100000:1.0:1789635265.043073:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410451328 00000100:00100000:1.0:1789635265.043130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789635265.043141:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+27:10280:x1876568410451328:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789635265.043743:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+28:10280:x1876568410451328:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 601us (852us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789635265.043752:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1789635265.149716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635265.149821:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410451584 00000100:00100000:2.0:1789635265.149832:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410451584 00000100:00100000:2.0:1789635265.149911:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1789635265.149923:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+28:10290:x1876568410451584:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635265.149948:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635265.149969:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb30ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0c5 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635265.150073:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789635265.150201:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb30ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0c5 expref: 30 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.150710:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635265.150715:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635265.150721:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb30ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0c5 expref: 30 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.150737:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821600, rc 0) 00000100:00100000:2.0:1789635265.150802:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+29:10290:x1876568410451584:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 881us (1096us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789635265.150809:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1789635265.157724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635265.157826:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410451712 00000100:00100000:1.0:1789635265.157837:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410451712 00000100:00100000:1.0:1789635265.157898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1789635265.157909:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+29:10290:x1876568410451712:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1789635265.157986:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158003:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158015:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158048:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158056:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158062:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158173:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158182:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158189:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635265.158232:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158244:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158250:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158256:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158263:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635265.158267:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158281:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158294:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:1.0:1789635265.158297:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635265.158301:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158307:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb30bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158355:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158361:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158366:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158371:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635265.158374:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158379:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158387:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d898a400) 00010000:00010000:1.0:1789635265.158389:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635265.158392:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158408:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb30c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158421:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158425:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158429:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158432:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635265.158433:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158437:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158441:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635265.158442:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635265.158444:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.158447:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.158617:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+29:10290:x1876568410451712:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 710us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635265.158623:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:3.0:1789635265.160573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635265.161776:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410451968 00000100:00100000:0.0:1789635265.161786:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410451968 00000100:00100000:0.0:1789635265.161836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789635265.161844:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+29:10290:x1876568410451968:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635265.162057:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+30:10290:x1876568410451968:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 213us (1491us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789635265.162062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789635265.200384:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635265.200581:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410452224 00000100:00100000:2.0:1789635265.200593:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410452224 00000100:00100000:2.0:1789635265.200657:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789635265.200668:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+30:10293:x1876568410452224:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635265.200702:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635265.200723:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb30d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0cc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200819:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200842:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200858:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200869:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200873:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200983:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200989:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.200994:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635265.201000:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789635265.201259:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201266:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201273:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201278:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635265.201288:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201297:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201368:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:2.0:1789635265.201373:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635265.201378:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201385:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb30d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201399:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201405:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201411:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201416:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635265.201419:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201425:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201431:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3700) 00010000:00010000:2.0:1789635265.201433:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635265.201442:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201448:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb30de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201489:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb30d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201504:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.201510:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:2.0:1789635265.201512:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635265.201514:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820c00, rc 0) 00000100:00100000:2.0:1789635265.201580:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+32:10293:x1876568410452224:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 913us (1204us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789635265.201588:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789635265.205605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635265.205751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410452352 00000100:00100000:1.0:1789635265.205762:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410452352 00000100:00100000:1.0:1789635265.205823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:1.0:1789635265.205832:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+32:10293:x1876568410452352:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1789635265.205900:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.205917:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.205930:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.205957:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.205964:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.205971:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.205978:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635265.205982:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.205990:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.206002:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635265.206004:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635265.206008:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.206024:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb30f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.206093:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+32:10293:x1876568410452352:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 262us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635265.206099:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:3.0:1789635265.209857:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635265.209997:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410452608 00000100:00100000:0.0:1789635265.210008:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410452608 00000100:00100000:0.0:1789635265.210079:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789635265.210090:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+32:10293:x1876568410452608:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635265.210564:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+33:10293:x1876568410452608:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 475us (716us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789635265.210572:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:1.0:1789635265.557933:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635265.643190:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635265.644223:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410452864 00000100:00100000:2.0:1789635265.644236:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410452864 00000100:00100000:2.0:1789635265.646329:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:2.0:1789635265.646355:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+33:10324:x1876568410452864:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789635265.646383:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635265.646403:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb30fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0d3 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.646711:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.646746:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.646758:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635265.646771:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789635265.646926:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb30fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0d3 expref: 36 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.646947:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0d3 expref: 35 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.646956:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:2.0:1789635265.646959:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635265.646962:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820800, rc 0) 00000100:00100000:2.0:1789635265.647360:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+35:10324:x1876568410452864:12345-192.168.201.30@tcp:101:cat.0 Request processed in 1016us (4178us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789635265.647368:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:2.0:1789635265.654249:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635265.654508:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410453120 00000100:00100000:1.0:1789635265.654518:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410453120 00000100:00100000:1.0:1789635265.654613:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1789635265.654623:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+35:10324:x1876568410453120:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:1.0:1789635265.654910:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+36:10324:x1876568410453120:12345-192.168.201.30@tcp:35:cat.0 Request processed in 287us (672us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789635265.654917:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1789635265.666973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635265.668906:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410453248 00000100:00100000:2.0:1789635265.668921:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410453248 00000100:00100000:2.0:1789635265.669003:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1789635265.669015:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+36:2350:x1876568410453248:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635265.669171:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635265.669198:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0d3 expref: 36 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.669240:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:2.0:1789635265.669246:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635265.669395:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+35:2350:x1876568410453248:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 380us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635265.669402:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1789635265.778468:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635265.778649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410453504 00000100:00100000:1.0:1789635265.778660:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410453504 00000100:00100000:1.0:1789635265.778764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1789635265.778776:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+35:10330:x1876568410453504:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1789635265.778805:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635265.778808:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789635265.778835:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3067 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0a9 expref: 35 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.778856:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:1.0:1789635265.778861:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635265.778875:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb310f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0da expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.779086:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.779102:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.779111:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.779144:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.779159:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 35 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635265.779173:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422011392:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635265.779354:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7939a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635265.783556:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635265.783910:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422011392:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635265.783940:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635265.787921:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410453632 00000100:00100000:2.0:1789635265.787938:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410453632 00010000:00010000:2.0:1789635265.787991:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 36 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635265.788046:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1789635265.788057:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+36:2348:x1876568410453632:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635265.788075:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635265.788082:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 36 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.788096:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 36 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.788125:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb30e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0cc expref: 36 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.788142:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:2.0:1789635265.788147:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.788170:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.788179:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635265.788230:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635265.788299:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+35:2348:x1876568410453632:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 244us (4752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635265.788306:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00010000:00010000:1.0:1789635265.793926:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.793947:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635265.793976:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789635265.794187:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb310f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.794232:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.794242:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635265.794245:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789635265.794249:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175600, rc 0) 00000100:00100000:1.0:1789635265.794354:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+35:10330:x1876568410453504:12345-192.168.201.30@tcp:101:dd.0 Request processed in 15580us (15896us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789635265.794363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1789635265.801286:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635265.801775:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410453888 00000100:00100000:0.0:1789635265.801787:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410453888 00000100:00100000:0.0:1789635265.801859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1789635265.801870:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+35:10330:x1876568410453888:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1789635265.802184:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.802203:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635265.802214:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635265.802294:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789635265.802359:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a54cc946 reply state 000000000009d68a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635265.802369:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635265.802489:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+38:10330:x1876568410453888:12345-192.168.201.30@tcp:36:dd.0 Request processed in 620us (1211us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789635265.802497:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000020:00080000:0.0:1789635265.802502:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789635265.805355:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.805375:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.805384:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.805390:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635265.805396:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.805404:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.805422:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635265.805425:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635265.805445:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635265.805452:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635266.266024:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635266.266221:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410454016 00000100:00100000:2.0:1789635266.266241:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410454016 00000100:00100000:2.0:1789635266.266374:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:2.0:1789635266.266386:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+37:10344:x1876568410454016:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1789635266.266413:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635266.266434:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb312b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0e1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266616:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266631:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266643:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266658:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266693:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266701:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266792:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266803:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266811:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266847:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635266.266862:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 38 pid: 5842 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635266.266876:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422011520:192.168.201.30@tcp:104: 00000100:00080000:0.0:1789635266.267112:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635266.267267:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7c1ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635266.279979:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635266.280082:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422011520:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635266.280106:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635266.287852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410454272 00000100:00100000:0.0:1789635266.287867:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410454272 00000100:00100000:0.0:1789635266.287951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789635266.287960:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+39:5580:x1876568410454272:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789635266.288295:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+40:5580:x1876568410454272:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 334us (8323us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789635266.288303:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1789635266.293486:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635266.293630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410454400 00000100:00100000:0.0:1789635266.293640:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410454400 00010000:00010000:0.0:1789635266.293706:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 40 pid: 5842 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635266.293748:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1789635266.293758:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+40:2349:x1876568410454400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635266.293772:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635266.293779:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 40 pid: 5842 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.293806:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 40 pid: 5842 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.293828:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3116 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0da expref: 40 pid: 5842 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.293845:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:0.0:1789635266.293850:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.293859:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.293866:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.294476:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635266.294530:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+39:2349:x1876568410454400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 772us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635266.294539:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00010000:00010000:3.0:1789635266.295172:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295183:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635266.295245:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789635266.295250:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635266.295294:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295341:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295353:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295361:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295367:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295372:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635266.295377:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295384:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295396:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635266.295399:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635266.295403:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295408:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295431:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295438:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295451:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295456:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635266.295459:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295465:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295581:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3600) 00010000:00010000:3.0:1789635266.295584:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635266.295588:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295593:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295633:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb312b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e1 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.295646:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e1 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635266.296463:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:3.0:1789635266.296465:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635266.296904:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821000, rc 0) 00000100:00100000:3.0:1789635266.296980:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+38:10344:x1876568410454016:12345-192.168.201.30@tcp:101:stat.0 Request processed in 30595us (30962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635266.296989:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789635266.410803:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635266.411158:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410454656 00000100:00100000:0.0:1789635266.411172:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410454656 00000100:00100000:0.0:1789635266.411261:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1789635266.411275:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+38:10350:x1876568410454656:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:0.0:1789635266.411386:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635266.411419:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e1 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.411475:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:0.0:1789635266.411482:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635266.411764:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.411781:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.411806:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635266.411873:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789635266.411914:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000128c0e4a reply state 00000000cf667659 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635266.412394:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635266.412595:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+40:10350:x1876568410454656:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 1321us (1817us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789635266.412604:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000020:00080000:0.0:1789635266.412610:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789635266.415038:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.415057:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.415065:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.415071:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635266.415094:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.415103:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.415410:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:0.0:1789635266.415415:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635266.415420:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.415427:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3147 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.580915:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635266.814668:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635266.817793:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410454784 00000100:00100000:1.0:1789635266.817814:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410454784 00000100:00100000:1.0:1789635266.817904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:1.0:1789635266.817915:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+39:10364:x1876568410454784:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:1.0:1789635266.817947:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635266.817976:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb314e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0e8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818063:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818080:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818093:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818131:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818139:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818146:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818283:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818298:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635266.818386:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789635266.818391:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635266.818419:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818433:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818442:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818449:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818456:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818672:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635266.818677:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818685:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818709:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:1.0:1789635266.818712:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635266.818718:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818724:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818741:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818748:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818754:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818760:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635266.818763:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818769:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818778:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d898a400) 00010000:00010000:1.0:1789635266.818780:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635266.818783:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818789:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb315c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818839:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb314e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818854:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635266.818862:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635266.818864:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635266.818867:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85e00, rc 0) 00000100:00100000:1.0:1789635266.818967:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+40:10364:x1876568410454784:12345-192.168.201.30@tcp:101:stat.0 Request processed in 1052us (4324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635266.818975:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1789635266.959938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635266.960213:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410455040 00000100:00100000:0.0:1789635266.960226:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410455040 00000100:00100000:0.0:1789635266.960299:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789635266.960342:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+40:10374:x1876568410455040:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635266.960371:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635266.960396:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb316a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0ef expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635266.960524:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789635266.960695:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb316a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0ef expref: 42 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.960712:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:0.0:1789635266.960715:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635266.960721:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb316a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0ef expref: 42 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635266.960751:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030400, rc 0) 00000100:00100000:0.0:1789635266.961054:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+41:10374:x1876568410455040:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 744us (1128us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789635266.961062:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:2.0:1789635266.984180:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635266.986282:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410455296 00000100:00100000:0.0:1789635266.986300:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410455296 00000100:00100000:0.0:1789635266.986407:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789635266.986420:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+41:10374:x1876568410455296:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635266.986729:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+42:10374:x1876568410455296:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 312us (2563us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789635266.986738:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000040:00080000:3.0:1789635267.092293:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789635267.192075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635267.192270:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410455552 00000100:00100000:1.0:1789635267.192281:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410455552 00000100:00100000:1.0:1789635267.192401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:1.0:1789635267.192412:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+42:10380:x1876568410455552:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789635267.192436:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635267.192455:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3178 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0f6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.192549:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.192563:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.192572:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.192615:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.192628:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 43 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635267.192641:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1d47800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422011648:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635267.192749:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e7939a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635267.230897:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1d47800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422011648:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635267.230933:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635267.230936:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635267.232987:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410455680 00000100:00100000:3.0:1789635267.233004:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410455680 00010000:00010000:3.0:1789635267.233076:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 44 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635267.233139:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1789635267.233152:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+44:2348:x1876568410455680:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635267.233171:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635267.233179:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 44 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.233196:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 44 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.233226:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0e8 expref: 44 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.233269:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:3.0:1789635267.233275:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.233287:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.233296:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.233395:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635267.233452:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.233470:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635267.233494:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:3.0:1789635267.233628:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+44:2348:x1876568410455680:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 476us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635267.233640:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00010000:00010000:1.0:1789635267.233753:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3178 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.233779:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.233788:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635267.233791:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789635267.233806:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85200, rc 0) 00000100:00100000:1.0:1789635267.234250:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+43:10380:x1876568410455552:12345-192.168.201.30@tcp:101:bash.0 Request processed in 41838us (42183us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789635267.234259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:3.0:1789635267.448228:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635267.449246:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410455936 00000100:00100000:2.0:1789635267.449260:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410455936 00000100:00100000:2.0:1789635267.449343:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1789635267.449355:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+43:10380:x1876568410455936:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:2.0:1789635267.452300:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.452345:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.452357:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635267.453804:0:7562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789635267.454449:0:7562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a311d824 reply state 000000000ee396bd transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635267.454463:0:7562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635267.454578:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+46:10380:x1876568410455936:12345-192.168.201.30@tcp:36:bash.0 Request processed in 5222us (6359us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789635267.454589:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000020:00080000:2.0:1789635267.454595:0:7562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789635267.475823:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.476198:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.476207:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.476381:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635267.476388:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.476397:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.476439:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:3.0:1789635267.476442:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635267.476449:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.476456:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb318d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635267.482860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635267.482949:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410456064 00000100:00100000:0.0:1789635267.482963:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410456064 00000100:00100000:0.0:1789635267.483038:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:0.0:1789635267.483050:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+45:10380:x1876568410456064:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635267.483080:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635267.483106:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3194 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d0fd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.483249:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.483266:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.483288:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.483359:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.483374:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 46 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635267.483389:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7180380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422011776:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635267.483500:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635267.506188:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635267.506261:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410456192 00000100:00100000:1.0:1789635267.506273:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410456192 00010000:00010000:1.0:1789635267.506341:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 47 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635267.506385:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:1.0:1789635267.506397:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+47:2348:x1876568410456192:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635267.506416:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635267.506423:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 47 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.506439:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 47 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635267.506703:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7180380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422011776:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635267.508525:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb317f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0f6 expref: 47 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.516660:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.526025:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635267.526044:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.526064:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.526095:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.526163:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635267.526255:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+46:2348:x1876568410456192:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 19853us (20074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635267.526266:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00010000:00010000:3.0:1789635267.527403:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.527416:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635267.527482:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789635267.527488:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635267.527519:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.527563:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3194 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0fd expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.527588:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0fd expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635267.527598:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:3.0:1789635267.527601:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635267.527604:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031000, rc 0) 00000100:00100000:3.0:1789635267.527658:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+45:10380:x1876568410456064:12345-192.168.201.30@tcp:101:bash.0 Request processed in 44610us (44820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635267.527679:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:0.0:1789635267.546231:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635267.546478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410456448 00000100:00100000:2.0:1789635267.546492:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410456448 00000100:00100000:2.0:1789635267.546559:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:2.0:1789635267.546572:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d32c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+45:10380:x1876568410456448:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1789635267.546900:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d32c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+46:10380:x1876568410456448:12345-192.168.201.30@tcp:35:bash.0 Request processed in 329us (681us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789635267.547072:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00010000:00010000:3.0:1789635267.605592:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789635267.617436:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:1.0:1789635267.617502:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789635267.617527:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79dbf31f00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789635267.617532:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79dbc8fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79dbf31840 00000020:00080000:1.0:1789635267.617535:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79dbc8fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79c80ab800 00000001:00080000:1.0:1789635267.617581:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000100:00100000:1.0:1789635267.618023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422011904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789635267.618112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789635267.618287:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789635267.618442:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789635267.618618:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422011904 00000100:00100000:2.0:1789635267.618629:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422011904 00000100:00100000:2.0:1789635267.618725:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635267.618736:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422011904:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1789635267.618852:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789635267.618974:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789635267.619018:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aabaac2, atime: 0x6aabaac2, ctime: 0x6aabaac2, blocks: 0x1 00010000:00010000:2.0:1789635267.619028:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.619048:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=243s v=(0 0) 00010000:00010000:2.0:1789635267.619053:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635267.619060:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.619080:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.619091:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.619099:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.619126:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635267.619585:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635267.619593:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.619602:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635267.619607:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.619618:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.619668:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.619677:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6b23423/0x77332204cfbb31a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.619700:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635267.619702:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635267.619704:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789635267.620698:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79c73bd180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789635267.620707:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422011904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789635267.621123:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876568422011904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2387us (3009us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789635267.621139:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635267.873895:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635267.877230:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410456704 00000100:00100000:0.0:1789635267.877250:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410456704 00000100:00100000:0.0:1789635267.877385:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1789635267.877399:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+14:10390:x1876568410456704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635267.877434:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635267.877625:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb31a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d104 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635267.878106:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789635267.880076:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb31a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d104 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.880122:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:0.0:1789635267.880126:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635267.880133:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb31a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d104 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.880151:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030400, rc 0) 00000100:00100000:0.0:1789635267.880235:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+15:10390:x1876568410456704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2838us (6354us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789635267.880244:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:2.0:1789635267.888516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635267.888739:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410456832 00000100:00100000:0.0:1789635267.888752:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410456832 00000100:00100000:0.0:1789635267.888822:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1789635267.888832:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:10390:x1876568410456832:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1789635267.888951:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.888970:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.888983:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889009:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889016:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889045:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889615:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889626:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889647:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635267.889700:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889715:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889722:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889729:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889735:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635267.889740:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889747:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889843:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635267.889962:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635267.889969:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.889977:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb31b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890035:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890042:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890049:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890054:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635267.890057:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890063:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890071:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d088ee00) 00010000:00010000:0.0:1789635267.890073:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635267.890076:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890081:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890098:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890111:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890117:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890121:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635267.890124:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890130:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890137:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:0.0:1789635267.890139:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635267.890142:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635267.890147:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635267.891726:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:10390:x1876568410456832:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 2886us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635267.891739:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1789635267.894595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635267.894940:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410457088 00000100:00100000:2.0:1789635267.894954:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410457088 00000100:00100000:2.0:1789635267.895028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1789635267.895042:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+15:10390:x1876568410457088:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635267.895478:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+16:10390:x1876568410457088:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 427us (883us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789635267.895487:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:3.0:1789635267.975178:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635267.975366:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410457344 00000100:00100000:1.0:1789635267.975380:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410457344 00000100:00100000:1.0:1789635267.975463:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789635267.975487:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+16:10393:x1876568410457344:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789635267.975525:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635267.975552:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb31cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d10b expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.975674:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.975694:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.975707:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.975748:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.975756:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.975764:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.977749:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb31e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.977771:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb31e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.977783:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb31e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635267.977797:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789635267.979726:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979743:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979751:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979757:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635267.979763:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979794:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979813:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:1.0:1789635267.979816:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635267.979822:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979828:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb31d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979846:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979852:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979857:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979863:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635267.979866:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979872:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979879:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d898a700) 00010000:00010000:1.0:1789635267.979882:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635267.979885:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979907:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb31da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.979978:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb31cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d10b expref: 19 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.981559:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb31e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d10b expref: 18 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635267.981787:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:1.0:1789635267.981790:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635267.981795:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635267.982130:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+18:10393:x1876568410457344:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 6648us (6965us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789635267.982141:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789635267.996948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635267.997202:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635267.997350:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410457472 00000100:00100000:2.0:1789635267.997364:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410457472 00000100:00100000:2.0:1789635267.997456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1789635267.997468:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:10393:x1876568410457472:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789635267.997576:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997599:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997615:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997660:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997668:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997676:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997701:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635267.997707:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997716:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997739:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:2.0:1789635267.997742:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635267.997748:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635267.997755:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb31ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635267.997862:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:10393:x1876568410457472:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 394us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635267.997870:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1789635267.999927:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410457600 00000100:00100000:3.0:1789635267.999944:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410457600 00000100:00100000:3.0:1789635268.000248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1789635268.000263:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+18:2350:x1876568410457600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635268.000283:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635268.000339:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb31e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d10b expref: 18 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635268.000363:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:3.0:1789635268.000369:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635268.000456:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+17:2350:x1876568410457600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 193us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635268.005278:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:1.0:1789635268.008015:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635268.012569:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410457856 00000100:00100000:2.0:1789635268.012593:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410457856 00000100:00100000:2.0:1789635268.012719:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789635268.012732:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+17:10393:x1876568410457856:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635268.013176:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+18:10393:x1876568410457856:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 444us (5170us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789635268.013192:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00080000:1.0:1789635268.013888:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635268.265967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635268.266074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410458112 00000100:00100000:0.0:1789635268.266087:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410458112 00000100:00100000:0.0:1789635268.266213:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1789635268.266227:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+18:10411:x1876568410458112:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:0.0:1789635268.266260:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635268.266302:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d112 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.266485:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.266503:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.266519:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635268.266531:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789635268.266721:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb31f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d112 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.266745:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d112 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.266755:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:0.0:1789635268.266759:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789635268.266763:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031400, rc 0) 00000100:00100000:0.0:1789635268.266853:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:10411:x1876568410458112:12345-192.168.201.30@tcp:101:cat.0 Request processed in 621us (893us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789635268.266861:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1789635268.295746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635268.295999:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410458240 00000100:00100000:3.0:1789635268.296014:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410458240 00000100:00100000:3.0:1789635268.296107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1789635268.296120:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+20:10412:x1876568410458240:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635268.296156:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635268.296185:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb320b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d119 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635268.296644:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635268.296663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635268.296678:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635268.296796:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789635268.296801:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635268.296832:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635268.296938:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb320b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d119 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635268.296966:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d119 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635268.296977:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635268.296980:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635268.296985:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:3.0:1789635268.297124:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+21:10412:x1876568410458240:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1007us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635268.297133:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:2.0:1789635268.307285:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635268.307494:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410458624 00000100:00100000:0.0:1789635268.307508:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410458624 00000100:00100000:0.0:1789635268.307568:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789635268.307580:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:10412:x1876568410458624:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635268.308198:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+22:10412:x1876568410458624:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 619us (926us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789635268.308206:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:3.0:1789635268.318575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635268.318774:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410458752 00000100:00100000:0.0:1789635268.318789:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410458752 00000100:00100000:0.0:1789635268.318873:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1789635268.318886:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+22:10412:x1876568410458752:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:0.0:1789635268.319028:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789635268.319059:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb319b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0fd expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.319087:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb31fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d112 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.319102:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb30a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d0be expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.319114:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3800) 00010000:00010000:0.0:1789635268.319126:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635268.319380:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+19:10412:x1876568410458752:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 495us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635268.319389:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:3.0:1789635268.324519:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635268.324828:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410458880 00000100:00100000:1.0:1789635268.324843:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410458880 00000100:00100000:1.0:1789635268.325099:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:1.0:1789635268.325114:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:10412:x1876568410458880:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:1.0:1789635268.325555:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635268.325577:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635268.325596:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635268.327688:0:7562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635268.328681:0:7562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789635268.329006:0:7562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789635268.329242:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:10412:x1876568410458880:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 4123us (4729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635268.329256:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1789635268.362726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635268.362836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410459008 00000100:00100000:0.0:1789635268.362979:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410459008 00000100:00100000:0.0:1789635268.363080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1789635268.363092:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+19:10414:x1876568410459008:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635268.363136:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635268.363161:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3220 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d120 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363399:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363418:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363442:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363469:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363476:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363814:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363823:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363831:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635268.363879:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789635268.363890:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635268.363912:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363925:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363935:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363941:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.363948:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364000:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635268.364005:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364013:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364026:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635268.364029:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635268.364034:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364040:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364056:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364071:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364077:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364082:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635268.364084:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364090:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364098:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d088ee00) 00010000:00010000:0.0:1789635268.364100:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635268.364103:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364108:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb322e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364147:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb3220 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364162:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635268.364169:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d898a700) 00010000:00010000:0.0:1789635268.364171:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635268.364179:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030800, rc 0) 00000100:00100000:0.0:1789635268.365039:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:10414:x1876568410459008:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1944us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635268.365048:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:3.0:1789635268.371580:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422012032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635268.372006:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635268.372710:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422012032 00000100:00100000:0.0:1789635268.372721:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422012032 00000100:00100000:0.0:1789635268.372924:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789635268.372935:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876568422012032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635268.372982:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635268.373131:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876568422012032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635268.373140:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789635268.373690:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422012032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789635268.633480:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635269.139712:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635269.139724:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635269.139789:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789635269.139796:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635269.139964:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe761180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422012160:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789635269.140173:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca472a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635269.222672:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe761180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422012160:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789635269.228799:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.228923:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410459136 00000100:00100000:0.0:1789635269.228937:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410459136 00000100:00100000:0.0:1789635269.229006:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1789635269.229018:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e05ee327-d920-4885-acb2-a26d789e134c+20:10426:x1876568410459136:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789635269.229129:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e05ee327-d920-4885-acb2-a26d789e134c+20:10426:x1876568410459136:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 Request processed in 113us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635269.229138:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789635269.236749:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.236820:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410459264 00000100:00100000:3.0:1789635269.236835:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410459264 00000100:00100000:3.0:1789635269.236913:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:3.0:1789635269.236925:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:10426:x1876568410459264:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789635269.236965:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789635269.237094:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:10426:x1876568410459264:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 171us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635269.237103:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1789635269.239737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.239815:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410459392 00000100:00100000:3.0:1789635269.239825:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410459392 00000100:00100000:3.0:1789635269.239899:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1789635269.239910:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+20:10426:x1876568410459392:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789635269.239996:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240016:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240045:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240598:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240633:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240647:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240689:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240698:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240706:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635269.240751:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789635269.240756:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635269.240773:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240785:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240792:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240815:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240823:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.240827:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240834:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240847:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:3.0:1789635269.240851:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635269.240856:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240863:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb323c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240879:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240885:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240891:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240896:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.240899:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240916:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240926:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9e79d91ba000) 00010000:00010000:3.0:1789635269.240928:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635269.240931:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240937:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3243 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240953:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240959:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240964:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240970:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.240973:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240981:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.240987:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d898a700) 00010000:00010000:3.0:1789635269.240990:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635269.240993:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.241010:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb324a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.241117:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+20:10426:x1876568410459392:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1205us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635269.241127:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:2.0:1789635269.248279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.250057:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410459648 00000100:00100000:0.0:1789635269.250072:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410459648 00000100:00100000:0.0:1789635269.250140:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1789635269.250152:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:10426:x1876568410459648:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635269.250178:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635269.250202:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3251 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d127 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250358:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250375:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250388:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635269.250400:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789635269.250519:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250527:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250535:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250541:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635269.250546:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250554:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250568:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d898a700) 00010000:00010000:0.0:1789635269.250571:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635269.250576:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250589:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250652:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3251 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d127 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250663:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:0.0:1789635269.250666:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635269.250670:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3251 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d127 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.250680:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030200, rc 0) 00000100:00100000:0.0:1789635269.250759:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:10426:x1876568410459648:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 609us (2493us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1789635269.250767:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1789635269.262899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.263020:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410459776 00000100:00100000:1.0:1789635269.263034:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410459776 00000100:00100000:1.0:1789635269.263101:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1789635269.263113:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:10426:x1876568410459776:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789635269.263159:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789635269.263301:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:10426:x1876568410459776:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 190us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635269.263332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1789635269.266980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.267096:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410460032 00000100:00100000:3.0:1789635269.267108:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410460032 00000100:00100000:3.0:1789635269.267183:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:3.0:1789635269.267195:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:10426:x1876568410460032:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635269.267219:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635269.267223:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789635269.267256:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d119 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.267280:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635269.267286:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635269.267302:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3266 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d12e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635269.268042:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789635269.268344:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb326d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.268360:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb326d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.268371:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb326d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.268438:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3266 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d12e expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.268453:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb326d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d12e expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.268461:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635269.268464:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635269.268467:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72000, rc 0) 00000100:00100000:3.0:1789635269.268539:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+22:10426:x1876568410460032:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1346us (1569us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789635269.268548:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:2.0:1789635269.279905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.280642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410460288 00000100:00100000:0.0:1789635269.280657:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410460288 00000100:00100000:0.0:1789635269.280723:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:0.0:1789635269.280734:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:10426:x1876568410460288:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789635269.280805:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635269.280926:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb326d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d12e expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.280946:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:0.0:1789635269.280958:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635269.280989:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281014:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281027:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281044:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281051:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281057:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281513:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281523:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281530:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281537:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635269.281541:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281550:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281560:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635269.281568:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635269.281573:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281579:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb327b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281590:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281597:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281603:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281618:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635269.281621:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281627:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281635:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x60878389 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635269.281638:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635269.281640:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.281647:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3282 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x60878389 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635269.281743:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:10426:x1876568410460288:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1009us (1849us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635269.281757:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1789635269.287997:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.288104:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410460416 00000100:00100000:3.0:1789635269.288117:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410460416 00000100:00100000:3.0:1789635269.288195:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:3.0:1789635269.288209:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:10426:x1876568410460416:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635269.288251:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635269.288284:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3289 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d135 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.288346:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.288363:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.288377:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.289116:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.289138:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.289148:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:3.0:1789635269.289151:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635269.289155:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:3.0:1789635269.289232:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+22:10426:x1876568410460416:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1027us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635269.289240:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:3.0:1789635269.292064:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635269.292514:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410460672 00000100:00100000:2.0:1789635269.292526:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410460672 00000100:00100000:2.0:1789635269.292589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:2.0:1789635269.292601:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+22:10426:x1876568410460672:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635269.292712:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.292731:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.292743:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635269.294056:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789635269.294075:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 245113762246ns, next at 246113759078ns, rc = 0 00000004:00010000:2.0:1789635269.294218:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fe3a8bd reply state 00000000cf01e441 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635269.294229:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635269.294390:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+24:10426:x1876568410460672:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1788us (2331us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789635269.294399:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00010000:00010000:1.0:1789635269.297250:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.297269:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.297297:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.297305:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635269.297337:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.297349:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.297373:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:1.0:1789635269.297376:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789635269.297383:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.297390:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3297 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.297617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635269.299753:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410460800 00000100:00100000:2.0:1789635269.299768:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410460800 00000100:00100000:2.0:1789635269.299849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:2.0:1789635269.299860:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+23:10426:x1876568410460800:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635269.299890:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635269.299913:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d13c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.299981:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.299996:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.300017:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:2.0:1789635269.300020:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635269.300024:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820800, rc 0) 00000100:00100000:2.0:1789635269.300097:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:10426:x1876568410460800:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 239us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.300104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:1.0:1789635269.303075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635269.303412:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410460928 00000100:00100000:2.0:1789635269.303433:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410460928 00000100:00100000:2.0:1789635269.303494:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:2.0:1789635269.303505:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876568410460928:12345-192.168.201.30@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789635269.303546:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1789635269.303586:0:6693:0:(genops.c:1384:class_connect()) connect: client e05ee327-d920-4885-acb2-a26d789e134c, cookie 0x77332204cfbb32a5 00002000:00100000:2.0:1789635269.303600:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e05ee327-d920-4885-acb2-a26d789e134c/ffff9e79d082f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789635269.303638:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789635269.303941:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789635269.303978:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79d0828000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635269.304059:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2347:x1876568410460928:12345-192.168.201.30@tcp:8:lhsmtool_posix.0 Request processed in 554us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.304066:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:3.0:1789635269.314866:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.315002:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410461056 00000100:00100000:0.0:1789635269.315016:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410461056 00000100:00100000:0.0:1789635269.315105:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:0.0:1789635269.315117:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:0:x1876568410461056:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789635269.316882:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635269.475498:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:0:x1876568410461056:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 160362us (160625us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789635269.475513:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000001:00080000:0.0:1789635269.475550:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1789635269.475560:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000040:00080000:1.0:1789635269.475934:0:12004:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635269.475940:0:12004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635269.475973:0:12004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789635269.475979:0:12004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789635269.487334:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.497976:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410461312 00000100:00100000:1.0:1789635269.497992:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410461312 00000100:00100000:1.0:1789635269.498952:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1789635269.498968:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:10426:x1876568410461312:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789635269.499297:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+25:10426:x1876568410461312:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 332us (11995us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789635269.499335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789635269.504394:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.504447:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410461568 00000100:00100000:0.0:1789635269.504458:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410461568 00000100:00100000:0.0:1789635269.504523:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:0.0:1789635269.504534:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+25:10426:x1876568410461568:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789635269.504832:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+25:10426:x1876568410461568:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 299us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635269.504841:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:3.0:1789635269.508917:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635269.509185:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410461696 00000100:00100000:2.0:1789635269.509195:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410461696 00000100:00100000:2.0:1789635269.509250:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:2.0:1789635269.509260:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+25:10426:x1876568410461696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635269.509281:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635269.509303:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d143 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.509388:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb32b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.509402:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb32b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.509423:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb32b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635269.509454:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635269.509469:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb32b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.509500:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d143 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.509518:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb32b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d143 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.509539:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:2.0:1789635269.509543:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789635269.509545:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635269.509596:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+26:10426:x1876568410461696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 338us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.509799:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:1.0:1789635269.517551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.517585:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410461824 00000100:00100000:1.0:1789635269.517594:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410461824 00000100:00100000:1.0:1789635269.517739:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1789635269.517749:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410461824:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635269.517769:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635269.517791:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d14a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635269.517817:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabaac6, blocks: 0x1 00010000:00010000:1.0:1789635269.517834:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=245s v=(0 0) 00010000:00010000:1.0:1789635269.517839:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635269.517849:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.517868:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.517882:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635269.517936:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2351:x1876568410461824:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 188us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635269.517942:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789635269.522085:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.522254:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462080 00000100:00100000:0.0:1789635269.522265:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462080 00000100:00100000:0.0:1789635269.522409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:0.0:1789635269.522433:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+26:10426:x1876568410462080:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789635269.522536:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+26:10426:x1876568410462080:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 117us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635269.522553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1789635269.527621:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.527860:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462208 00000100:00100000:0.0:1789635269.527871:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462208 00000100:00100000:0.0:1789635269.527922:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:0.0:1789635269.527934:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:10426:x1876568410462208:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635269.527953:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635269.527971:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d151 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.528002:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.528012:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635269.528016:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635269.528021:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.528055:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.528068:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 7 pid: 6693 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635269.528082:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422012288:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635269.528520:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635269.531628:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7180000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422012288:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635269.531675:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.531696:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635269.531893:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:10426:x1876568410462208:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3960us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635269.531903:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:0.0:1789635269.546621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.546864:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462336 00000100:00100000:3.0:1789635269.546875:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462336 00010000:00010000:3.0:1789635269.546921:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 7 pid: 6693 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.546970:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1789635269.546983:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410462336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635269.546997:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635269.547029:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 7 pid: 6693 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.547045:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 7 pid: 6693 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.547071:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb32ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d14a expref: 7 pid: 6693 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.547388:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635269.547394:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635269.547403:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.547423:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.547562:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635269.547578:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7181500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1876568422012416:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789635269.547778:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635269.562358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.562426:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7181500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1876568422012416:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789635269.562452:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635269.562505:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410462336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 15525us (15902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635269.562517:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:0.0:1789635269.562681:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462464 00000100:00100000:0.0:1789635269.562689:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462464 00002000:00100000:0.0:1789635269.563076:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e79e7183480 x1876568410462464/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:645/0 lens 504/0 e 0 to 0 dl 1789635280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635269.563098:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7183480 with x1876568410462464 ext(0->8) 00002000:00010000:0.0:1789635269.563117:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7183480 00000100:00100000:0.0:1789635269.563145:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789635269.563155:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410462464:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789635269.570587:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410462464:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 7422us (8227us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789635269.570614:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00002000:00100000:0.0:1789635269.570628:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e79e7183480 x1876568410462464/t4294967302(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:645/0 lens 504/448 e 0 to 0 dl 1789635280 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635269.570648:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7183480 with x1876568410462464 ext(0->8) 00002000:00010000:0.0:1789635269.570655:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7183480 00000100:00100000:2.0:1789635269.573469:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.573673:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462592 00000100:00100000:3.0:1789635269.573684:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462592 00000100:00100000:3.0:1789635269.574217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789635269.574230:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+26:10426:x1876568410462592:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789635269.652537:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635269.658029:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+26:10426:x1876568410462592:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 83791us (84556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.658043:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000001:00080000:1.0:1789635269.661043:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:1.0:1789635269.661068:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1789635269.661082:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789635269.661182:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1789635269.661233:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789635269.661243:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789635269.661652:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635269.661671:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422012544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789635269.661857:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635269.664712:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422012544 00000100:00100000:1.0:1789635269.664728:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422012544 00000100:00100000:1.0:1789635269.664795:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789635269.664805:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422012544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789635269.664991:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789635269.664995:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789635271 00002000:00010000:1.0:1789635269.664997:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789635269.665000:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789635270 -> 1789635271 00002000:00010000:1.0:1789635269.665002:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789635269.665080:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422012544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (3223us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789635269.665265:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789635269.665290:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789635269.665357:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79c73bd500/2, rc 0, transno 4294967303 00000100:00100000:1.0:1789635269.665364:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422012544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789635269.666278:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.666655:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462720 00000100:00100000:1.0:1789635269.666664:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462720 00000100:00100000:1.0:1789635269.666930:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1789635269.666940:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410462720:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789635269.748102:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.748142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.748210:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.751118:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462976 00000100:00100000:1.0:1789635269.751135:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462976 00000100:00100000:1.0:1789635269.751195:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1789635269.751213:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410462976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635269.751438:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410462976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 226us (3345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635269.751446:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00080000:1.0:1789635269.751467:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635269.752132:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410463104 00000100:00100000:2.0:1789635269.752141:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410463104 00000100:00100000:2.0:1789635269.752200:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:2.0:1789635269.752209:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410463104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635269.752248:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410463104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.752254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00080000:1.0:1789635269.753939:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635269.757481:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410462848 00000100:00100000:3.0:1789635269.757497:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410462848 00000100:00100000:3.0:1789635269.758468:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 266 00000100:00100000:3.0:1789635269.758498:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410462848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635269.758582:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410462848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (10438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635269.758590:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 266 00000001:00080000:0.0:1789635269.826478:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1789635269.826498:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1789635269.826883:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410462720:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 159938us (160604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635269.826896:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1789635269.831269:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.831927:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410463360 00000100:00100000:1.0:1789635269.831938:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410463360 00000100:00100000:1.0:1789635269.831999:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:1.0:1789635269.832010:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+13:10426:x1876568410463360:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789635269.832063:0:7562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635269.832090:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb32b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d143 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.832106:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:1.0:1789635269.832122:0:7562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635269.832152:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.832165:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.832175:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635269.832594:0:7562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005752f83d reply state 000000004385c54e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.832615:0:7562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635269.832716:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+14:10426:x1876568410463360:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 707us (1456us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789635269.832723:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00010000:00010000:3.0:1789635269.834578:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.834592:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.834609:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.834615:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.834620:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.834637:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.834653:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:3.0:1789635269.834656:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635269.834660:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.834666:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb32c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635269.837402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.837795:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410463488 00000100:00100000:1.0:1789635269.837805:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410463488 00000100:00100000:1.0:1789635269.837858:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635269.837868:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410463488:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789635269.838096:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789635269.838100:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789635271 -> 1789635268 00002000:00010000:1.0:1789635269.838103:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789635266 00002000:00010000:1.0:1789635269.838105:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789635271 -> 1789635268 00002000:00010000:1.0:1789635269.838108:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789635269.838178:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410463488:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 312us (786us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789635269.838186:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1789635269.852573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635269.852634:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410463744 00000100:00100000:2.0:1789635269.852644:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410463744 00000100:00100000:2.0:1789635269.852703:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:2.0:1789635269.852714:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+13:10426:x1876568410463744:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789635269.852795:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.852812:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.852822:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.852855:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.852870:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 13 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635269.852883:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422012672:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635269.852972:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635269.860119:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.860437:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410463872 00000100:00100000:3.0:1789635269.860447:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410463872 00010000:00010000:3.0:1789635269.860495:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 14 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.860549:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789635269.860561:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:2348:x1876568410463872:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635269.860576:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635269.860583:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 14 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.860607:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 14 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.860639:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:3.0:1789635269.860644:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.860654:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.860662:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.860682:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635269.861033:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:2348:x1876568410463872:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 474us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635269.861041:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00010000:00010000:2.0:1789635269.864137:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d135 expref: 13 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635269.864163:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422012672:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635269.864186:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864196:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864202:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864246:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864253:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864260:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864266:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635269.864270:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864277:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864292:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:2.0:1789635269.864295:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789635269.864299:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.864305:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635269.864411:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+12:10426:x1876568410463744:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 11698us (11846us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789635269.864422:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1789635269.867969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635269.868215:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410464000 00000100:00100000:2.0:1789635269.868224:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410464000 00000100:00100000:3.0:1789635269.868329:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1789635269.868347:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410464000:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789635269.868394:0:8106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.868440:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.868450:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635269.868455:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635269.868459:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.868499:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.868514:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 7 pid: 6691 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.868530:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422012800:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635269.868622:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635269.879474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.879516:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410464128 00000100:00100000:3.0:1789635269.879526:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410464128 00010000:00010000:3.0:1789635269.879573:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 8 pid: 6691 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.879636:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1789635269.879649:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410464128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635269.879665:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635269.879698:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 8 pid: 6691 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.879713:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 8 pid: 6691 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.879740:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635269.879745:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635269.879752:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.879762:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.879785:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635269.880945:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410464128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1291us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635269.880958:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00010000:00010000:1.0:1789635269.881819:0:8106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb32c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d151 expref: 7 pid: 6691 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.881839:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422012800:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635269.881864:0:8106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881892:0:8106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881901:0:8106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881932:0:8106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881941:0:8106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881950:0:8106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881957:0:8106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635269.881962:0:8106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881970:0:8106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.881986:0:8106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.882004:0:8106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354961c2/0x77332204cfbb32d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.882066:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410464000:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 13727us (14107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635269.882073:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:1.0:1789635269.902779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635269.902899:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410464384 00000100:00100000:0.0:1789635269.902910:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410464384 00000100:00100000:0.0:1789635269.902966:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:0.0:1789635269.902976:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+12:10426:x1876568410464384:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789635269.903053:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.903070:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635269.903097:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.905461:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635269.908970:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635269.909005:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422012928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635269.909072:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635269.909614:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422012928 00000100:00100000:3.0:1789635269.909633:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422012928 00000100:00100000:3.0:1789635269.910522:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789635269.910539:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422012928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635269.910567:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789635269.910649:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422012928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635269.910656:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1789635269.911080:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.911089:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635269.911421:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422013312:0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.911458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635269.911516:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789635269.911521:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79c73bd500, transno 4294967303 00000100:00100000:2.0:1789635269.911537:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422012928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635269.911556:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635269.911561:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422013440:0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.911585:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635269.911815:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422013184:0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.911840:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635269.911857:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789635269.911862:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422013056:0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.911887:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635269.911908:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422013568:0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.911927:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635269.912258:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422013440 00000100:00100000:2.0:1789635269.912265:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422013440 00000100:00100000:2.0:1789635269.912340:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789635269.912349:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422013440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.912391:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422013440:12345-0@lo:400:kworker.0 Request processed in 44us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.912397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789635269.912417:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422013056 00000100:00100000:2.0:1789635269.912420:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422013056 00000100:00100000:2.0:1789635269.912450:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789635269.912456:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422013056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.914990:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422013056:12345-0@lo:400:kworker.0 Request processed in 2526us (3092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.915006:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1789635269.915061:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635269.915098:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422013440:0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.915137:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422013312 00000100:00100000:2.0:1789635269.915144:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422013312 00000100:00100000:2.0:1789635269.915179:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422013184 00000100:00100000:2.0:1789635269.915181:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422013184 00000100:00100000:2.0:1789635269.915192:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422013568 00000100:00100000:2.0:1789635269.915195:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422013568 00000100:00100000:2.0:1789635269.915217:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635269.915224:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422013312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.915277:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422013312:12345-0@lo:400:kworker.0 Request processed in 54us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.915284:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789635269.915296:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789635269.915302:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.915348:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422013184:12345-0@lo:400:kworker.0 Request processed in 47us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.915354:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789635269.915364:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789635269.915371:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422013568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.915396:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422013568:12345-0@lo:400:kworker.0 Request processed in 26us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635269.915414:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789635269.915429:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635269.915446:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422013312:0@lo:400:kworker.0 00010000:00010000:2.0:1789635269.916627:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.916649:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 13 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635269.916664:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422013696:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635269.916743:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635269.918796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422013056:0@lo:400:kworker.0 00000100:00100000:1.0:1789635269.918818:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422013568:0@lo:400:kworker.0 00000100:00100000:1.0:1789635269.918830:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422013184:0@lo:400:kworker.0 00000100:00100000:2.0:1789635269.927630:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422013696:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635269.927662:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635269.927809:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635269.928191:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410464512 00000100:00100000:1.0:1789635269.928200:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410464512 00010000:00010000:1.0:1789635269.928238:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 14 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.928273:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1789635269.928295:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+14:2348:x1876568410464512:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635269.928330:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635269.928338:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 14 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.928351:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 14 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.928375:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb329e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d13c expref: 14 pid: 5843 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.928392:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:1.0:1789635269.928396:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.928406:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.928416:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.928444:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635269.928515:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+13:2348:x1876568410464512:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 221us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635269.928523:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00010000:00010000:2.0:1789635269.928616:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.928624:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635269.928803:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1789635269.928945:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789635269.928993:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789635269.929095:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422013824:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789635269.929159:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635269.929197:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c80bb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635269.931694:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422013824 00000100:00100000:1.0:1789635269.931710:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422013824 00000100:00100000:1.0:1789635269.931765:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635269.931776:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876568422013824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789635269.931893:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876568422013824:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635269.931900:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635269.932043:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422013824:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789635269.932787:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789635269.932906:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422013952:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789635269.932947:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635269.932980:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635269.933126:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422013952 00000100:00100000:1.0:1789635269.933132:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422013952 00000100:00100000:1.0:1789635269.933170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635269.933177:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876568422013952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789635269.933537:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876568422013952:12345-0@lo:1000:mdt00_001.0 Request processed in 360us (588us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789635269.933545:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635269.934379:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422013952:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789635269.934427:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934437:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934444:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934450:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.934455:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934462:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934479:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91ba000) 00010000:00010000:3.0:1789635269.934483:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635269.934486:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934493:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb32e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934527:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934533:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934549:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934555:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.934557:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934563:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934571:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d898a700) 00010000:00010000:3.0:1789635269.934573:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635269.934575:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934581:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3219 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934609:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934622:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934631:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934660:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.934684:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 16 pid: 5842 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.934757:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422014080:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635269.934877:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789635269.937260:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635269.937454:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422014080:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635269.937482:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.938487:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410464640 00000100:00100000:1.0:1789635269.938497:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410464640 00010000:00010000:1.0:1789635269.938536:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 17 pid: 5842 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.938575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1789635269.938585:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+17:2348:x1876568410464640:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635269.938612:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635269.938620:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 17 pid: 5842 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.938641:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 17 pid: 5842 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.938662:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d120 expref: 17 pid: 5842 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.938694:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d898a700) 00010000:00010000:1.0:1789635269.938700:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.938709:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.938717:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635269.938745:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635269.938761:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938768:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938779:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938785:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938791:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938797:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.938801:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.938804:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+16:2348:x1876568410464640:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 220us (1552us total) trans 0 rc 0/0 00010000:00010000:3.0:1789635269.938809:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635269.938810:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00010000:00010000:3.0:1789635269.938835:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d898a700) 00010000:00010000:3.0:1789635269.938838:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635269.938842:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938848:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938859:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938864:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938869:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938874:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635269.938877:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938883:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938890:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d898a700) 00010000:00010000:3.0:1789635269.938893:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635269.938896:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.938901:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb32dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635269.939114:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+15:10426:x1876568410464384:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 36139us (36343us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789635269.939122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000020:00080000:3.0:1789635269.939126:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789635269.941230:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635269.941239:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635269.941276:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789635269.941282:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635269.942164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635269.942863:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410464896 00000100:00100000:2.0:1789635269.942875:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410464896 00000100:00100000:2.0:1789635269.942928:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1789635269.942937:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:10426:x1876568410464896:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789635269.943759:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789635269.943880:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789635269.943936:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.943953:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.943965:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.943974:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.943982:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.943988:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635269.944009:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789635269.944109:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+17:10426:x1876568410464896:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1170us (1948us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789635269.944118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000020:00080000:2.0:1789635269.944123:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789635269.945796:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635269.945808:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.945819:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635269.945823:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.945833:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.945850:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e79d91f3c00) 00010000:00010000:3.0:1789635269.945853:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789635269.945858:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.945864:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb32f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635269.945892:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635269.945894:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635269.945895:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789635270.511374:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:3.0:1789635270.511403:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1789635270.511524:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1789635270.677592:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635271.710531:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635271.849939:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635271.849948:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635271.849997:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789635271.850007:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635272.028683:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.028783:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410465152 00000100:00100000:3.0:1789635272.028803:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410465152 00000100:00100000:3.0:1789635272.028891:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:3.0:1789635272.028906:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+17:10444:x1876568410465152:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635272.028929:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635272.028948:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d158 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789635272.029025:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789635272.029057:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3300 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.029071:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3300 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.029082:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3300 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635272.029093:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789635272.029245:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb32f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d158 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.029263:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3300 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d158 expref: 19 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.029271:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635272.029274:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635272.029278:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73e00, rc 0) 00000100:00100000:3.0:1789635272.029836:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:10444:x1876568410465152:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 933us (1162us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789635272.029844:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:0.0:1789635272.060007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.060093:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410465280 00000100:00100000:2.0:1789635272.060105:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410465280 00000100:00100000:2.0:1789635272.060159:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:2.0:1789635272.060169:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+19:10444:x1876568410465280:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1789635272.060239:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060256:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060267:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060283:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060289:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060296:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060570:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060580:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060587:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635272.060632:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060645:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060650:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060656:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060661:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.060665:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060672:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060684:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:2.0:1789635272.060686:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635272.060690:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb330e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060705:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060710:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060721:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060726:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.060728:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060734:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060741:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3100) 00010000:00010000:2.0:1789635272.060743:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635272.060746:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060750:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060762:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060767:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060772:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060776:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.060778:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060791:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060799:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3700) 00010000:00010000:2.0:1789635272.060801:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635272.060804:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.060809:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb331c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635272.062176:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+19:10444:x1876568410465280:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 2000us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635272.062190:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:1.0:1789635272.233569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.234536:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410465536 00000100:00100000:3.0:1789635272.234550:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410465536 00000100:00100000:3.0:1789635272.234625:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1789635272.234636:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:10447:x1876568410465536:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635272.234669:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635272.234692:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d15f expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.234766:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.234793:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.234805:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.234819:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.234825:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.234831:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235084:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235093:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235112:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635272.235122:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789635272.235215:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235223:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235229:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235234:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.235238:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235246:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235258:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635272.235262:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.235266:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235271:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb332a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235293:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235298:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235336:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235342:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.235345:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235351:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.235360:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91ba000) 00010000:00010000:3.0:1789635272.240007:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.240020:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.240033:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb3331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.240130:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 22 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.240145:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 21 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.240154:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:3.0:1789635272.240157:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635272.240159:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72200, rc 0) 00000100:00100000:3.0:1789635272.240239:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+21:10447:x1876568410465536:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 5604us (6695us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789635272.240267:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1789635272.250905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.251132:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410465664 00000100:00100000:2.0:1789635272.251143:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410465664 00000100:00100000:2.0:1789635272.251202:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:2.0:1789635272.251213:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:10447:x1876568410465664:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789635272.251285:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251303:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251338:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251364:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251387:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251393:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251399:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.251403:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251410:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.251421:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:2.0:1789635272.252191:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635272.252199:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.252207:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635272.252293:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:10447:x1876568410465664:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 1081us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635272.252300:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1789635272.256466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.256572:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410465920 00000100:00100000:2.0:1789635272.256583:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410465920 00000100:00100000:2.0:1789635272.256631:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1789635272.256641:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:10447:x1876568410465920:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635272.256912:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:10447:x1876568410465920:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 272us (454us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789635272.256932:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1789635272.304257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635272.305363:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410466176 00000100:00100000:0.0:1789635272.305378:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410466176 00000100:00100000:0.0:1789635272.305447:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:0.0:1789635272.305459:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:9967:x1876568410466176:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635272.305489:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635272.305512:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb334d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d166 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.305625:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.305652:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 23 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.305662:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.305705:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 23 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.305740:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 23 pid: 7562 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635272.305754:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422014208:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635272.305864:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db959840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635272.318541:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635272.319375:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422014208:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635272.319416:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635272.321141:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410466304 00000100:00100000:1.0:1789635272.321218:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410466304 00010000:00010000:0.0:1789635272.324653:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 24 pid: 7562 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635272.324807:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:0.0:1789635272.324821:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+24:2349:x1876568410466304:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635272.324842:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635272.324851:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 24 pid: 7562 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.324868:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 24 pid: 7562 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.324899:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d15f expref: 24 pid: 7562 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.324923:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:0.0:1789635272.324946:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.324959:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.324968:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.325029:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635272.325110:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+23:2349:x1876568410466304:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 293us (6586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635272.325118:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00010000:00010000:2.0:1789635272.325200:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.325208:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635272.325230:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789635272.325452:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb334d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.325471:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.325479:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:2.0:1789635272.325482:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789635272.325485:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030200, rc 0) 00000100:00100000:2.0:1789635272.325514:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:9967:x1876568410466176:12345-192.168.201.30@tcp:101:bash.0 Request processed in 20058us (21269us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789635272.325522:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:3.0:1789635272.332745:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.332907:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410466560 00000100:00100000:2.0:1789635272.332922:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410466560 00000100:00100000:2.0:1789635272.332990:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:2.0:1789635272.333014:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+23:9967:x1876568410466560:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:2.0:1789635272.333442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.333465:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.333489:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635272.333566:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789635272.333598:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000383d6b71 reply state 00000000e3a9fd69 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635272.333609:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789635272.333662:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789635272.333940:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+27:9967:x1876568410466560:12345-192.168.201.30@tcp:36:bash.0 Request processed in 927us (1207us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789635272.333949:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00000020:00080000:2.0:1789635272.333954:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789635272.341268:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.341291:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.341299:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.341306:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635272.341575:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.341586:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.341609:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:0.0:1789635272.341612:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635272.341617:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.341647:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3362 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635272.341824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.342221:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410466688 00000100:00100000:3.0:1789635272.342236:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410466688 00000100:00100000:3.0:1789635272.342335:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:3.0:1789635272.342348:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+26:9967:x1876568410466688:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635272.342389:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635272.342413:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d16d expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.342492:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d16d expref: 27 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.342508:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d16d expref: 27 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.342531:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:3.0:1789635272.342534:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635272.342538:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73600, rc 0) 00000100:00100000:3.0:1789635272.342629:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+27:9967:x1876568410466688:12345-192.168.201.30@tcp:101:bash.0 Request processed in 283us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.342637:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:1.0:1789635272.348960:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.349055:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410466816 00000100:00100000:3.0:1789635272.349083:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410466816 00000100:00100000:3.0:1789635272.349206:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789635272.349227:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:9967:x1876568410466816:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635272.349252:0:8106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635272.349280:0:8106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d174 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635272.349344:0:8106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aabaac4, atime: 0x6aabaac2, ctime: 0x6aabaac4, blocks: 0xb 00010000:00010000:3.0:1789635272.349380:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=248s v=(0 0) 00010000:00010000:3.0:1789635272.349386:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635272.349396:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.349418:0:8106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.349433:0:8106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72e00, rc 0) 00000100:00100000:3.0:1789635272.349504:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:9967:x1876568410466816:12345-192.168.201.30@tcp:101:bash.0 Request processed in 288us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.351572:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789635272.355166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635272.355298:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410466944 00000100:00100000:1.0:1789635272.355355:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410466944 00002000:00010000:1.0:1789635272.355442:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789635272.355448:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7b64700 with x1876568410466944 ext(0->18446744073709551615) 00002000:00010000:1.0:1789635272.355466:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7b64700. 00000100:00100000:1.0:1789635272.355500:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1789635272.355513:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410466944:12345-192.168.201.30@tcp:10:bash.0 00002000:00010000:1.0:1789635272.355907:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789635272.355911:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789635268 -> 1789635273 00002000:00010000:1.0:1789635272.355914:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789635266 -> 1789635266 00002000:00010000:1.0:1789635272.355916:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789635268 -> 1789635273 00002000:00010000:1.0:1789635272.355919:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789635272.356000:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410466944:12345-192.168.201.30@tcp:10:bash.0 Request processed in 488us (847us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789635272.356009:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00002000:00010000:1.0:1789635272.356014:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789635272.356016:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7b64700 with x1876568410466944 ext(0->18446744073709551615) 00002000:00010000:1.0:1789635272.356022:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7b64700. 00000100:00080000:0.0:1789635272.357921:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635272.482487:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.483451:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410467072 00000100:00100000:3.0:1789635272.483468:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410467072 00000100:00100000:3.0:1789635272.483568:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:3.0:1789635272.483582:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+27:10461:x1876568410467072:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1789635272.483676:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.483717:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.483732:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.483749:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.483757:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.483764:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484031:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484040:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484048:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635272.484095:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484108:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484116:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484133:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484141:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.484146:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484156:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484179:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635272.484183:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.484189:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484196:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484210:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484216:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484222:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484228:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.484231:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484249:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484258:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91bab00) 00010000:00010000:3.0:1789635272.484260:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.484264:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484269:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb337e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484284:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484291:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484297:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.484302:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.484305:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.485584:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.485599:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:3.0:1789635272.485602:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.485605:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.485628:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635272.485736:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+27:10461:x1876568410467072:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 2154us (3259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.485746:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:3.0:1789635272.558269:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.559005:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410467328 00000100:00100000:2.0:1789635272.559020:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410467328 00000100:00100000:2.0:1789635272.559096:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:2.0:1789635272.559109:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+27:10464:x1876568410467328:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635272.559138:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635272.559165:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb338c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d17b expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559267:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559285:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559298:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559571:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559580:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559588:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559920:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb33a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559930:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb33a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.559938:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb33a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635272.559949:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789635272.560073:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560081:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560089:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560096:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.560101:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560120:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560134:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:2.0:1789635272.560137:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635272.560142:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560149:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560162:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560168:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560175:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560181:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.560183:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560189:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560196:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3700) 00010000:00010000:2.0:1789635272.560199:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635272.560202:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560636:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb339a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560695:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb338c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d17b expref: 30 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560712:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb33a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d17b expref: 29 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.560720:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:2.0:1789635272.560723:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789635272.560725:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635272.560993:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+29:10464:x1876568410467328:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1885us (2737us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789635272.561003:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:0.0:1789635272.577651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635272.578933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410467456 00000100:00100000:1.0:1789635272.578951:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410467456 00000100:00100000:1.0:1789635272.579044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:1.0:1789635272.579058:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+29:10464:x1876568410467456:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1789635272.579160:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.579181:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.579191:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.579259:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.579277:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 29 pid: 5842 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635272.579294:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e4bb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422014336:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635272.583968:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635272.605124:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635272.605304:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e4bb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422014336:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635272.605383:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635272.605537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410467712 00000100:00100000:2.0:1789635272.605546:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410467712 00000100:00100000:2.0:1789635272.605614:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:2.0:1789635272.605625:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+30:5580:x1876568410467712:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789635272.614520:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+31:5580:x1876568410467712:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 8879us (9394us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789635272.614535:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1789635272.623189:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635272.623333:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410467840 00000100:00100000:0.0:1789635272.623347:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410467840 00010000:00010000:0.0:1789635272.623405:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 31 pid: 5842 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635272.623453:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1789635272.623464:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+31:2349:x1876568410467840:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635272.623484:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635272.623491:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 31 pid: 5842 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.623507:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 31 pid: 5842 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.623535:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3354 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d166 expref: 31 pid: 5842 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.623564:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:0.0:1789635272.623585:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.623597:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.623606:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635272.623648:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635272.623710:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+30:2349:x1876568410467840:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 247us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635272.623747:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00010000:00010000:3.0:1789635272.631420:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.631441:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.631599:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.631609:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.631617:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.631651:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.631657:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.631665:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.631686:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:2.0:1789635272.631689:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635272.631695:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.631701:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb33af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635272.631833:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+29:10464:x1876568410467456:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 52772us (54192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635272.631845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:0.0:1789635272.650074:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635272.650199:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410468096 00000100:00100000:1.0:1789635272.650214:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410468096 00000100:00100000:1.0:1789635272.650289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1789635272.650301:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+29:10464:x1876568410468096:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789635272.650668:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+30:10464:x1876568410468096:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 369us (608us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789635272.650677:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00010000:00010000:1.0:1789635272.723756:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635272.803835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.803981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410468352 00000100:00100000:2.0:1789635272.803996:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410468352 00000100:00100000:2.0:1789635272.804090:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:2.0:1789635272.804102:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+30:10475:x1876568410468352:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789635272.804135:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635272.804179:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb33b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d182 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.804292:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.804372:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.804386:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.804403:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.804410:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.804416:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.807187:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb33cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.807451:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb33cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.807468:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb33cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635272.807485:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789635272.808471:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808484:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808492:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808519:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.808526:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808534:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808581:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:2.0:1789635272.808585:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635272.808590:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808597:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808624:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808630:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808656:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808662:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635272.808665:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808672:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808693:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3700) 00010000:00010000:2.0:1789635272.808695:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635272.808699:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.808705:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.810896:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb33b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d182 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.810933:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb33cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d182 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.810942:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:2.0:1789635272.810945:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635272.810949:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820c00, rc 0) 00000100:00100000:2.0:1789635272.811049:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+32:10475:x1876568410468352:12345-192.168.201.30@tcp:101:cat.0 Request processed in 6949us (7228us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789635272.811059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:0.0:1789635272.819150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635272.819375:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410468608 00000100:00100000:1.0:1789635272.819391:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410468608 00000100:00100000:1.0:1789635272.819462:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1789635272.819473:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+32:10475:x1876568410468608:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:1.0:1789635272.820044:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+33:10475:x1876568410468608:12345-192.168.201.30@tcp:35:cat.0 Request processed in 570us (907us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789635272.820053:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1789635272.846862:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.847017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410468864 00000100:00100000:2.0:1789635272.847032:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410468864 00000100:00100000:2.0:1789635272.847105:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:2.0:1789635272.847117:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+33:10476:x1876568410468864:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1789635272.847193:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789635272.847372:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb33cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d182 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847423:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb33a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d17b expref: 32 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847436:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d16d expref: 31 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847448:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:2.0:1789635272.847460:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635272.847484:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847499:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847510:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847525:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847532:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847538:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847948:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847957:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.847979:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635272.849148:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789635272.849162:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 248668849727ns, next at 249668846575ns, rc = 0 00010000:00010000:3.0:1789635272.849563:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849578:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849589:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849610:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849617:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849622:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849650:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635272.849677:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849683:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849689:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849696:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.849702:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849710:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849723:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3100) 00010000:00010000:3.0:1789635272.849726:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789635272.849731:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849746:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb33e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849988:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.849996:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.850002:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.850007:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.850010:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.850016:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.850025:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635272.850028:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.850031:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.850037:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb33d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635272.850048:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ac40659 reply state 00000000e6fe72f7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635272.850058:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789635272.850249:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635272.850262:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.850268:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635272.850271:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.850277:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.850287:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e79d91f3100) 00010000:00010000:1.0:1789635272.850290:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789635272.850293:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.850299:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb33ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.850330:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635272.850333:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635272.850335:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635272.850520:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+32:10476:x1876568410468864:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3401us (3668us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789635272.850529:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00010000:00010000:3.0:1789635272.864921:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.864944:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.864952:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.864960:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.864965:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.864974:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.865005:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3700) 00010000:00010000:3.0:1789635272.865008:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.865015:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.865021:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb33e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635272.907077:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.910638:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410469120 00000100:00100000:3.0:1789635272.910660:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410469120 00000100:00100000:3.0:1789635272.911057:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1789635272.911072:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+31:10482:x1876568410469120:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635272.911127:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635272.911156:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb33f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d189 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.911307:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.911349:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.911374:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.911392:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.911400:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.911407:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635272.912083:0:7562:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789635272.912279:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912293:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912304:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912406:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912413:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912420:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912427:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635272.912431:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912440:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912454:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635272.912457:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635272.912463:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912469:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb33fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635272.912484:0:7562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066cccfe3 reply state 000000004e9ae024 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635272.912494:0:7562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789635272.912530:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb33f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 34 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912572:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 33 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.912584:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635272.912587:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635272.912589:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73600, rc 0) 00000100:00100000:3.0:1789635272.912691:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+34:10482:x1876568410469120:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1624us (5628us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789635272.912700:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00010000:00010000:1.0:1789635272.919742:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.919764:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.919773:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.919781:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635272.919786:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.919822:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.919843:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91bae00) 00010000:00010000:1.0:1789635272.919847:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635272.919852:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635272.919859:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635272.930908:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635272.931117:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410469248 00000100:00100000:2.0:1789635272.931131:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410469248 00000100:00100000:2.0:1789635272.931212:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:2.0:1789635272.931225:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410469248:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789635272.931248:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635272.931274:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d190 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635272.931307:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789635272.931397:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=248s v=(0 0) 00010000:00010000:2.0:1789635272.931402:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635272.931412:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.931435:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635272.931451:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635272.931509:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410469248:12345-192.168.201.30@tcp:101:bash.0 Request processed in 288us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635272.931516:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00080000:0.0:1789635272.933657:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635272.934209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.934285:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410469376 00000100:00100000:3.0:1789635272.934295:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410469376 00000100:00100000:3.0:1789635272.934410:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:3.0:1789635272.934421:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:10482:x1876568410469376:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635272.934442:0:8106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635272.934463:0:8106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d197 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.934499:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.934509:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635272.934514:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635272.934519:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.934594:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.934610:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 7 pid: 6691 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635272.934626:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422014464:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635272.934727:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635272.937283:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422014464:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635272.937376:0:8106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.937402:0:8106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73200, rc 0) 00000100:00100000:3.0:1789635272.937464:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:10482:x1876568410469376:12345-192.168.201.30@tcp:101:bash.0 Request processed in 3044us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.937474:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:0.0:1789635272.942660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.944368:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410469504 00000100:00100000:3.0:1789635272.944387:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410469504 00010000:00010000:3.0:1789635272.944453:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 7 pid: 6691 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635272.944508:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789635272.944520:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410469504:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635272.944572:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635272.944601:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 7 pid: 6691 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.944619:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 7 pid: 6691 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.944647:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054353540/0x77332204cfbb3418 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d190 expref: 7 pid: 6691 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.944669:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635272.944674:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635272.944683:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 6 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.944695:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 6 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635272.944744:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 6 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635272.944772:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1876568422014592:192.168.201.30@tcp:105: 00000100:00100000:3.0:1789635272.944881:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635272.950739:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1876568422014592:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789635272.950799:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635272.950900:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410469504:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6380us (8251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635272.950913:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1789635272.954426:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635272.956532:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410469760 00000100:00100000:3.0:1789635272.956560:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410469760 00000100:00100000:3.0:1789635272.956651:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1789635272.956663:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+33:10482:x1876568410469760:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1789635272.959678:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+34:10482:x1876568410469760:12345-192.168.201.30@tcp:35:bash.0 Request processed in 3002us (5247us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789635272.959702:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1789635273.178882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.179003:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410469888 00000100:00100000:0.0:1789635273.179017:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410469888 00000100:00100000:0.0:1789635273.179090:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:0.0:1789635273.179102:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+34:10498:x1876568410469888:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635273.179137:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635273.179165:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d19e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.179252:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb342d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.179284:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb342d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.179297:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb342d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635273.179376:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789635273.179381:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635273.179400:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb342d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.179430:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d19e expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.179452:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb342d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d19e expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.179462:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635273.179466:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635273.179470:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030a00, rc 0) 00000100:00100000:0.0:1789635273.179564:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+35:10498:x1876568410469888:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 463us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635273.179572:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:2.0:1789635273.187570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635273.187720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410470144 00000100:00100000:3.0:1789635273.187734:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410470144 00000100:00100000:3.0:1789635273.187831:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:3.0:1789635273.187845:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+35:10498:x1876568410470144:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635273.187874:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635273.187902:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.188031:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb343b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.188046:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb343b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.188061:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb343b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635273.188073:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789635273.188248:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1a5 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.188269:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb343b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1a5 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.188277:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635273.188281:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635273.188285:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72200, rc 0) 00000100:00100000:3.0:1789635273.188740:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+37:10498:x1876568410470144:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 897us (1181us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789635273.188748:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:1.0:1789635273.202527:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635273.202824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.207858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410470528 00000100:00100000:0.0:1789635273.207878:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410470528 00000100:00100000:0.0:1789635273.207983:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:0.0:1789635273.207996:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+37:10498:x1876568410470528:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635273.208030:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635273.208071:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1ac expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.208198:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3450 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.208217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3450 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.208231:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3450 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635273.208245:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789635273.208450:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1ac expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.208474:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3450 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1ac expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.208485:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:0.0:1789635273.208488:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789635273.208492:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030400, rc 0) 00000100:00100000:0.0:1789635273.208603:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+39:10498:x1876568410470528:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 609us (5779us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789635273.208611:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:3.0:1789635273.215582:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410470272 00000100:00100000:3.0:1789635273.215602:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410470272 00000100:00100000:3.0:1789635273.215695:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1789635273.215708:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+39:2350:x1876568410470272:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635273.215726:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635273.215757:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb343b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1a5 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.215779:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635273.215784:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635273.215861:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+38:2350:x1876568410470272:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 156us (13349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635273.215869:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789635273.223988:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.228840:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410470656 00000100:00100000:2.0:1789635273.228865:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410470656 00000100:00100000:2.0:1789635273.228980:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1789635273.229011:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410470656:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:2.0:1789635273.229091:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.229116:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 6 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.229126:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789635273.229130:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635273.229135:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.229190:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 6 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.229208:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 6 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635273.229226:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876568422014720:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635273.229378:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c4f12e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635273.233071:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876568422014720:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635273.233108:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635273.234273:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.234378:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410470784 00000100:00100000:0.0:1789635273.234393:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410470784 00002000:00100000:0.0:1789635273.234466:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e79e4bb3100 x1876568410470784/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:649/0 lens 504/0 e 0 to 0 dl 1789635284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635273.234478:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e4bb3100 with x1876568410470784 ext(0->8) 00010000:00010000:0.0:1789635273.234495:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 7 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.234513:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 7 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635273.234522:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79e4bb3100 00000100:00100000:0.0:1789635273.234563:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1789635273.234575:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410470784:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:0.0:1789635273.235183:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:2348:x1876568410470784:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 608us (913us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789635273.235192:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00002000:00100000:0.0:1789635273.235200:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e79e4bb3100 x1876568410470784/t4294967302(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:649/0 lens 504/448 e 0 to 0 dl 1789635284 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635273.235209:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e4bb3100 with x1876568410470784 ext(0->8) 00010000:00010000:0.0:1789635273.235215:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 9 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.235228:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 9 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635273.235235:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79e4bb3100 00000100:00100000:1.0:1789635273.237882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.238074:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410470912 00000100:00100000:0.0:1789635273.238087:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410470912 00010000:00010000:0.0:1789635273.238132:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 9 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635273.238204:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1789635273.238216:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410470912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635273.238234:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789635273.238257:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789635273.238261:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789635274 00002000:00010000:0.0:1789635273.238263:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789635274 00002000:00010000:0.0:1789635273.238266:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789635274 00010000:00010000:0.0:1789635273.238272:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 9 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.238289:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 9 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.238364:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb341f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d197 expref: 9 pid: 8106 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.238385:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635273.238391:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635273.238398:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.238409:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.238738:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635273.238889:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410470912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 672us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635273.238898:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00010000:00010000:2.0:1789635273.239806:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239823:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239858:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239867:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239876:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239884:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635273.239890:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239900:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239917:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.239944:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be6266e1/0x77332204cfbb345e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635273.240070:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410470656:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 11078us (16117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.240080:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:1.0:1789635273.249042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.252697:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410471168 00000100:00100000:2.0:1789635273.252722:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410471168 00000100:00100000:2.0:1789635273.252829:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:2.0:1789635273.252841:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+38:10498:x1876568410471168:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:2.0:1789635273.252926:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3450 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1ac expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635273.253249:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1789635273.253302:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789635273.256231:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1789635273.258613:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.258674:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 42 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.258685:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.258745:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 42 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.258779:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 42 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635273.258799:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876568422014848:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635273.258932:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2dd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635273.261085:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b66d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876568422014848:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635273.261140:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635273.272181:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635273.273868:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410471296 00000100:00100000:3.0:1789635273.273886:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410471296 00010000:00010000:3.0:1789635273.273952:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 43 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635273.274004:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1789635273.274017:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+43:2348:x1876568410471296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635273.274034:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635273.274042:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 43 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.274059:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 43 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.274103:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb340a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d189 expref: 43 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.274125:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635273.274132:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.274142:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.274151:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.274193:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635273.274280:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+42:2348:x1876568410471296:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 266us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635273.274288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00010000:00010000:2.0:1789635273.276171:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.276193:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635273.276633:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789635273.276901:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1789635273.277028:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422014976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789635273.277105:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635273.277137:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7b32480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635273.277571:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422014976 00000100:00100000:1.0:1789635273.277581:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422014976 00000100:00100000:1.0:1789635273.277660:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635273.277671:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422014976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789635273.277772:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422014976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635273.277787:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789635273.278021:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635273.278052:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789635273.278059:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1789635273.278082:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79c73bd180, transno 4294967301 00000100:00100000:2.0:1789635273.278158:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422014976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789635273.278843:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789635273.278907:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422015104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789635273.278944:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635273.278974:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c4f12e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635273.279088:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422015104 00000100:00100000:1.0:1789635273.279094:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422015104 00000100:00100000:1.0:1789635273.279131:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635273.279138:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422015104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789635273.279300:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876568422015104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (355us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789635273.279308:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635273.279982:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422015104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789635273.280040:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789635273.280086:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.280098:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.280107:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.280112:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635273.280118:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.280126:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.280147:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:0.0:1789635273.280150:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789635273.280154:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.280161:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3465 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635273.280388:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789635273.280551:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789635273.280563:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 249100250801ns, next at 250100248158ns, rc = 0 00000001:00080000:0.0:1789635273.280569:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789635273.280601:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:0.0:1789635273.280614:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789635273.280623:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3450 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1ac expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635273.280737:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+45:10498:x1876568410471168:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 27897us (31707us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789635273.280745:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000020:00080000:0.0:1789635273.280750:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789635273.289011:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.289095:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410471424 00000100:00100000:2.0:1789635273.289106:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410471424 00000100:00100000:2.0:1789635273.289174:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:2.0:1789635273.289185:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+45:10498:x1876568410471424:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635273.289214:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635273.289241:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb346c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1b3 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.289354:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb346c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1b3 expref: 46 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.289372:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb346c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1b3 expref: 46 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.289417:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635273.289421:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635273.289425:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820c00, rc 0) 00000100:00100000:2.0:1789635273.289492:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+46:10498:x1876568410471424:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 309us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.289500:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:2.0:1789635273.297626:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635273.300793:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410471680 00000100:00100000:3.0:1789635273.300812:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410471680 00000100:00100000:3.0:1789635273.301674:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:3.0:1789635273.301692:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+46:10498:x1876568410471680:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789635273.301989:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+47:10498:x1876568410471680:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 303us (4377us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789635273.301997:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1789635273.495650:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635273.495683:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422015232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635273.495778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635273.495962:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422015232 00000100:00100000:2.0:1789635273.495974:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422015232 00000100:00100000:2.0:1789635273.496088:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635273.496102:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422015232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635273.496134:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635273.496200:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422015232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.496208:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789635273.496290:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422015232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635273.505699:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.505806:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410471808 00000100:00100000:0.0:1789635273.505821:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410471808 00000100:00100000:0.0:1789635273.505896:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:0.0:1789635273.505909:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+47:10508:x1876568410471808:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1789635273.506018:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506041:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506054:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506071:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506079:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506085:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506206:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506224:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506231:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635273.506288:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506304:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506455:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506463:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506471:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635273.506476:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506485:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506500:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635273.506503:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635273.506508:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506514:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3473 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506855:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506864:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506870:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506875:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635273.506878:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506884:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506892:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d088ef00) 00010000:00010000:0.0:1789635273.506894:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635273.506897:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506903:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb347a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506919:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506924:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506930:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506941:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635273.506944:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506949:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506957:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:0.0:1789635273.506959:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635273.506962:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.506967:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3481 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635273.509727:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+47:10508:x1876568410471808:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 3803us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635273.509745:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:1.0:1789635273.542762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.543007:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410472064 00000100:00100000:2.0:1789635273.543022:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410472064 00000100:00100000:2.0:1789635273.543104:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:2.0:1789635273.543118:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+47:10511:x1876568410472064:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635273.543143:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635273.543170:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3488 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1ba expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543266:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543308:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543383:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543402:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543410:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543417:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543592:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb349d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543601:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb349d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543609:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb349d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635273.543620:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789635273.543745:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543907:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543914:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543929:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635273.543934:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543944:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543958:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:2.0:1789635273.543961:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635273.543967:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543973:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb348f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543990:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.543996:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544002:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544008:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635273.544010:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544015:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544032:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3400) 00010000:00010000:2.0:1789635273.544034:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635273.544037:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544043:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544093:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3488 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1ba expref: 50 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544108:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb349d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1ba expref: 49 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.544116:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635273.544118:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635273.544120:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821e00, rc 0) 00000100:00100000:2.0:1789635273.544201:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+49:10511:x1876568410472064:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1086us (1462us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789635273.544210:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:2.0:1789635273.553445:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635273.553649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410472192 00000100:00100000:1.0:1789635273.553664:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410472192 00000100:00100000:1.0:1789635273.553728:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:1.0:1789635273.553740:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+49:10511:x1876568410472192:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1789635273.553850:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.553877:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.553891:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.553950:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.553958:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.553966:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.553972:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635273.553977:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.553985:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.554017:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:1.0:1789635273.554020:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635273.554026:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.554033:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635273.554130:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+49:10511:x1876568410472192:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 390us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635273.554138:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:1.0:1789635273.556968:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.557153:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410472448 00000100:00100000:2.0:1789635273.557164:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410472448 00000100:00100000:2.0:1789635273.557239:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:2.0:1789635273.557251:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+49:10511:x1876568410472448:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635273.557928:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+50:10511:x1876568410472448:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 679us (967us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789635273.557956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:2.0:1789635273.682686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635273.682810:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410472704 00000100:00100000:3.0:1789635273.682824:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410472704 00000100:00100000:3.0:1789635273.682905:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:3.0:1789635273.682937:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+50:10521:x1876568410472704:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635273.682974:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635273.682978:0:7562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789635273.683014:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb342d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d19e expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.683039:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635273.683045:0:7562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635273.683061:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb34b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1c1 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.683183:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb34b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.683198:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb34b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.683209:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb34b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635273.683234:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789635273.683553:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb34b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c1 expref: 52 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.683570:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb34b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c1 expref: 51 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.683578:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635273.683580:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635273.683588:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72200, rc 0) 00000100:00100000:3.0:1789635273.683671:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+51:10521:x1876568410472704:12345-192.168.201.30@tcp:101:bash.0 Request processed in 738us (1000us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789635273.683680:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:0.0:1789635273.688255:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635273.688471:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410472960 00000100:00100000:1.0:1789635273.688486:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410472960 00000100:00100000:1.0:1789635273.688583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:1.0:1789635273.688595:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+51:10521:x1876568410472960:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:1.0:1789635273.688669:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789635273.688704:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb34b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c1 expref: 51 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.688740:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb349d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1ba expref: 50 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.688759:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:1.0:1789635273.688765:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635273.689031:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.689048:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.689060:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635273.689117:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789635273.689140:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000294ea95a reply state 000000008aa64a43 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635273.689152:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635273.689278:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+52:10521:x1876568410472960:12345-192.168.201.30@tcp:36:bash.0 Request processed in 684us (1036us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789635273.689286:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 104 00000020:00080000:1.0:1789635273.689291:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789635273.694386:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.694578:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410473088 00000100:00100000:2.0:1789635273.694592:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410473088 00000100:00100000:2.0:1789635273.694666:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:2.0:1789635273.694679:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+52:10521:x1876568410473088:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789635273.694712:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635273.694753:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb34ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1c8 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.694860:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.694882:0:7562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.694893:0:7562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.694916:0:7562:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.694929:0:7562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695157:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695167:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695175:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695182:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635273.695185:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695194:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695211:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635273.695214:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635273.695216:0:3292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695225:0:3292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695233:0:3292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695268:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.695284:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb34c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.695645:0:7562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.695653:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635273.695698:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789635273.695703:0:7562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635273.695737:0:7562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.695852:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb34ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 53 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.695867:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 52 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.695875:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635273.695877:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635273.695880:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635273.695984:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+52:10521:x1876568410473088:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1307us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.695993:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:2.0:1789635273.713058:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635273.713158:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410473344 00000100:00100000:3.0:1789635273.713171:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410473344 00000100:00100000:3.0:1789635273.713267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789635273.713282:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:10521:x1876568410473344:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1789635273.715912:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+53:10521:x1876568410473344:12345-192.168.201.30@tcp:35:bash.0 Request processed in 2622us (2857us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789635273.715924:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00010000:00010000:1.0:1789635273.748067:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635273.776218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635273.776368:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410473472 00000100:00100000:1.0:1789635273.776380:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410473472 00000100:00100000:1.0:1789635273.776572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:1.0:1789635273.776590:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+53:10527:x1876568410473472:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789635273.776623:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635273.776648:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb34dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1cf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.776803:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb34e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.776820:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb34e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.776834:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb34e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635273.776886:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789635273.776891:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635273.776914:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb34e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.776942:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb34dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1cf expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.776963:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb34e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1cf expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635273.776972:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:1.0:1789635273.776991:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635273.776995:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635273.777291:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+54:10527:x1876568410473472:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 704us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635273.777300:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:1.0:1789635273.781855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.781960:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410473600 00000100:00100000:0.0:1789635273.781975:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410473600 00000100:00100000:0.0:1789635273.782055:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:0.0:1789635273.782068:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+54:10527:x1876568410473600:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635273.782098:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635273.782133:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb34ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1d6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782248:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782266:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782279:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782297:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782305:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782360:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb34ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782769:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb34ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782780:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb34ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635273.782830:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789635273.782836:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635273.782859:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb34ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782886:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb34ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782897:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782905:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782912:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782918:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635273.782923:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782932:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782945:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635273.782948:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635273.782953:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782960:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb34f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782974:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782981:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782993:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.782998:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635273.783001:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.783008:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.783016:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d088ef00) 00010000:00010000:0.0:1789635273.783019:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635273.783022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.783027:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb34f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.783066:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb34ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1d6 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.783081:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb34ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1d6 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.783089:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:0.0:1789635273.783092:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635273.783095:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031000, rc 0) 00000100:00100000:0.0:1789635273.783419:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+55:10527:x1876568410473600:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1352us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635273.783438:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:2.0:1789635273.791266:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.791416:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.791480:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410473984 00000100:00100000:0.0:1789635273.791492:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410473984 00000100:00100000:3.0:1789635273.791626:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410473728 00000100:00100000:3.0:1789635273.791631:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410473728 00000100:00100000:0.0:1789635273.791673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:0.0:1789635273.791685:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+56:10527:x1876568410473984:12345-192.168.201.30@tcp:101:lfs.0 00000100:00100000:3.0:1789635273.791695:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1789635273.791703:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+56:2348:x1876568410473728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635273.791710:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635273.791718:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635273.791733:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1dd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.791744:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb34ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1d6 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.791763:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635273.791768:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635273.791836:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+56:2348:x1876568410473728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 134us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635273.791845:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00010000:00010000:0.0:1789635273.791858:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.791873:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 55 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.791882:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.791927:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 55 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635273.792299:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 55 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635273.792341:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422015360:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635273.792468:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db959e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635273.799948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635273.799998:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422015360:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635273.800056:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635273.800211:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410474112 00000100:00100000:3.0:1789635273.800221:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410474112 00010000:00010000:3.0:1789635273.800272:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 56 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635273.800340:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789635273.800351:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+56:2349:x1876568410474112:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635273.800366:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635273.800372:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 56 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.800383:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 56 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.800404:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb34d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1c8 expref: 56 pid: 7562 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.800418:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635273.800422:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.800430:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.800435:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.800491:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635273.800598:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+55:2349:x1876568410474112:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 247us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635273.800606:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00010000:00010000:2.0:1789635273.800758:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.800766:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635273.800789:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789635273.801284:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.801346:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.801354:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635273.801364:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789635273.801367:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031400, rc 0) 00000100:00100000:2.0:1789635273.801412:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+55:10527:x1876568410473984:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 9729us (9994us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789635273.801424:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:2.0:1789635273.805786:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635273.805831:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410474368 00000100:00100000:3.0:1789635273.805859:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410474368 00000100:00100000:3.0:1789635273.805938:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1789635273.805952:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+55:10527:x1876568410474368:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:3.0:1789635273.805970:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635273.806000:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb346c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1b3 expref: 55 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.806020:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635273.806026:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635273.806117:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+54:10527:x1876568410474368:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 170us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635273.806130:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1789635273.808029:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635273.808086:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410474496 00000100:00100000:2.0:1789635273.808097:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410474496 00000100:00100000:2.0:1789635273.808158:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:2.0:1789635273.808169:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+54:10527:x1876568410474496:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:2.0:1789635273.808295:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.808331:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635273.808346:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635273.808604:0:7562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789635273.808720:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+54:10527:x1876568410474496:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 552us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635273.808749:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:1.0:1789635273.810614:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635273.810779:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410474624 00000100:00100000:3.0:1789635273.810790:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410474624 00000100:00100000:3.0:1789635273.810890:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:3.0:1789635273.810899:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+54:10527:x1876568410474624:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635273.810920:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635273.810940:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.810993:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.811004:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.811027:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.811072:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.811089:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635273.811093:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635273.811096:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635273.811102:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72600, rc 0) 00000100:00100000:3.0:1789635273.811171:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+55:10527:x1876568410474624:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 272us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635273.811178:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000040:00080000:3.0:1789635274.067901:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635274.067916:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635274.067995:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789635274.068003:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635274.068190:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b65f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422015488:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789635274.068392:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635274.076054:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.076171:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410474752 00000100:00100000:0.0:1789635274.076186:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410474752 00000100:00100000:3.0:1789635274.076453:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b65f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422015488:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635274.077670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:0.0:1789635274.077696:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+55:10528:x1876568410474752:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789635274.077749:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789635274.077881:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+55:10528:x1876568410474752:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 199us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.077890:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00080000:2.0:1789635274.085606:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635274.087834:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.087904:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410474880 00000100:00100000:2.0:1789635274.087919:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410474880 00000100:00100000:2.0:1789635274.087997:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789635274.088011:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+55:10528:x1876568410474880:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789635274.088113:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.088135:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.088159:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089213:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089548:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089563:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089605:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089614:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089620:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635274.089686:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789635274.089692:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635274.089706:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089718:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089724:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089731:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089738:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635274.089742:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089749:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089762:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:2.0:1789635274.089766:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635274.089771:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089776:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3529 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089791:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089807:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089813:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089818:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635274.089821:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089826:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089834:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9e79d91f3400) 00010000:00010000:2.0:1789635274.089837:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635274.089840:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089846:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3530 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089862:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089869:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089874:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089879:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635274.089887:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089894:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089902:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635274.089905:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635274.089907:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.089913:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.090022:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+55:10528:x1876568410474880:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 2010us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.092735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.092801:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410475136 00000100:00100000:0.0:1789635274.092817:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410475136 00000100:00100000:0.0:1789635274.092893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:0.0:1789635274.092907:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+56:10528:x1876568410475136:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635274.092934:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635274.092962:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb353e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1eb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093080:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093095:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093107:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635274.093147:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:2.0:1789635274.093157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 00010000:00010000:0.0:1789635274.093276:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093287:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093293:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093300:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635274.093305:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093345:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093359:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:0.0:1789635274.093363:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789635274.093367:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093373:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3545 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093432:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb353e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1eb expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093444:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:0.0:1789635274.093446:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635274.093457:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb353e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1eb expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.093467:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030800, rc 0) 00000100:00100000:0.0:1789635274.093558:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+56:10528:x1876568410475136:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 655us (837us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789635274.093566:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:1.0:1789635274.107883:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635274.108194:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410475264 00000100:00100000:3.0:1789635274.108205:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410475264 00000100:00100000:3.0:1789635274.108285:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1789635274.108299:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+56:10528:x1876568410475264:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789635274.109167:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789635274.109291:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+56:10528:x1876568410475264:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 994us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635274.109712:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:2.0:1789635274.116651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.116758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410475520 00000100:00100000:0.0:1789635274.116770:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410475520 00000100:00100000:0.0:1789635274.116827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:0.0:1789635274.116837:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+56:10528:x1876568410475520:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635274.116859:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635274.116862:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635274.116889:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb34e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1cf expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.116909:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:0.0:1789635274.116914:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635274.116928:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3553 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1f2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635274.117608:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789635274.117813:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb355a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.117828:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb355a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.117838:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb355a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.117907:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3553 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f2 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.117924:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb355a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f2 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.117932:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d088ef00) 00010000:00010000:0.0:1789635274.117934:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635274.117937:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635274.118649:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+57:10528:x1876568410475520:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1811us (2006us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789635274.118660:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:1.0:1789635274.135228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.135345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410475776 00000100:00100000:2.0:1789635274.135361:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410475776 00000100:00100000:2.0:1789635274.135432:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1789635274.135443:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+57:10528:x1876568410475776:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635274.135508:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635274.135551:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb355a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f2 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.135574:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d088ef00) 00010000:00010000:2.0:1789635274.135589:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635274.135616:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.135644:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.135655:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137084:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137108:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137118:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137207:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137214:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137221:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137228:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635274.137233:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137240:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137252:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:2.0:1789635274.137269:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635274.137274:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137281:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb3568 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137294:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137300:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137305:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137324:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635274.137328:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137335:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137343:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x955db82a (ffff9e79d91f3400) 00010000:00010000:2.0:1789635274.137346:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635274.137349:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.137354:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb356f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x955db82a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.137476:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+56:10528:x1876568410475776:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 2030us (2266us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635274.137493:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1789635274.146797:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635274.146885:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410475904 00000100:00100000:3.0:1789635274.146904:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410475904 00000100:00100000:3.0:1789635274.147004:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:3.0:1789635274.147017:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+56:10528:x1876568410475904:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635274.147046:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635274.147077:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3576 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d1f9 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.147122:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.147136:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.147149:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.147287:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 58 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.147496:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 57 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.147509:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635274.147513:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635274.147517:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72800, rc 0) 00000100:00100000:3.0:1789635274.147615:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+57:10528:x1876568410475904:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 600us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635274.147634:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:3.0:1789635274.151885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.154470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410476160 00000100:00100000:2.0:1789635274.154497:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410476160 00000100:00100000:2.0:1789635274.154608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:2.0:1789635274.154620:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+57:10528:x1876568410476160:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635274.154737:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.154759:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.154773:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635274.155083:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789635274.155093:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 249974781063ns, next at 250974778473ns, rc = 0 00000004:00010000:2.0:1789635274.155201:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e88867d7 reply state 0000000086b912a8 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.155213:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635274.155412:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+59:10528:x1876568410476160:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 792us (3538us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789635274.155422:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00010000:00010000:3.0:1789635274.159770:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.159793:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.159802:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.159809:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635274.159814:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.159823:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.159844:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635274.159847:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789635274.159852:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.159859:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3584 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.160929:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.161465:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410476288 00000100:00100000:0.0:1789635274.161482:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410476288 00000100:00100000:0.0:1789635274.161569:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1789635274.161580:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+58:10528:x1876568410476288:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635274.161607:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635274.161629:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d200 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.161692:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 59 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.161714:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 59 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.163417:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:1.0:1789635274.163429:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635274.163434:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030800, rc 0) 00000100:00100000:1.0:1789635274.163548:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+59:10528:x1876568410476288:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1963us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.163559:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:1.0:1789635274.171075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.171187:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410476416 00000100:00100000:0.0:1789635274.171202:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410476416 00000100:00100000:0.0:1789635274.171303:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1789635274.171369:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410476416:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789635274.171387:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635274.172075:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:2348:x1876568410476416:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 710us (1016us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789635274.172086:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1789635274.178161:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.178354:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410476672 00000100:00100000:1.0:1789635274.178369:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410476672 00000100:00100000:1.0:1789635274.178441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:1.0:1789635274.178454:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+59:10528:x1876568410476672:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789635274.178809:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+60:10528:x1876568410476672:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 356us (667us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789635274.178818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1789635274.191464:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.191667:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410476928 00000100:00100000:1.0:1789635274.191682:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410476928 00000100:00100000:1.0:1789635274.191793:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:1.0:1789635274.191807:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+60:10528:x1876568410476928:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789635274.191978:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+60:10528:x1876568410476928:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 173us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.191987:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:2.0:1789635274.196254:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635274.203272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410477056 00000100:00100000:3.0:1789635274.203290:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410477056 00000100:00100000:3.0:1789635274.203398:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:3.0:1789635274.203432:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+60:10528:x1876568410477056:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635274.203456:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635274.207706:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3592 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d207 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.208638:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3599 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.208661:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.208678:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635274.208727:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635274.208821:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.208864:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d207 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.208886:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d207 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.208907:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:0.0:1789635274.208911:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789635274.208916:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635274.209157:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+61:10528:x1876568410477056:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 5727us (12912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.209176:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:0.0:1789635274.216452:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635274.219742:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410477184 00000100:00100000:3.0:1789635274.219766:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410477184 00000100:00100000:2.0:1789635274.219931:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:2.0:1789635274.219949:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410477184:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635274.219993:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635274.220023:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d20e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635274.220058:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabaacb, blocks: 0x1 00010000:00010000:2.0:1789635274.220082:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=250s v=(0 0) 00010000:00010000:2.0:1789635274.220088:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635274.220099:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.220120:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.220135:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635274.220273:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+10:2349:x1876568410477184:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 330us (3832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635274.220281:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:0.0:1789635274.226070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.226398:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410477440 00000100:00100000:1.0:1789635274.226414:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410477440 00000100:00100000:1.0:1789635274.226488:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:1.0:1789635274.226500:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+61:10528:x1876568410477440:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789635274.226687:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+61:10528:x1876568410477440:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 188us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.226699:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:1.0:1789635274.229852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635274.230176:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410477568 00000100:00100000:3.0:1789635274.230188:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410477568 00000100:00100000:3.0:1789635274.230261:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1789635274.230274:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+10:10528:x1876568410477568:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635274.230299:0:8106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635274.230363:0:8106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d215 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.230895:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.230907:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635274.230911:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635274.230916:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 11 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.230969:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.231005:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 11 pid: 6691 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.231023:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422015616:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635274.231306:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c4f12180 going to sleep for 11 seconds 00000100:00100000:3.0:1789635274.234065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.234070:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422015616:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635274.234164:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410477696 00000100:00100000:0.0:1789635274.234174:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410477696 00010000:00010000:0.0:1789635274.234224:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 12 pid: 6691 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.234479:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1789635274.234492:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+12:2348:x1876568410477696:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635274.234513:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635274.234554:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 12 pid: 6691 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.234571:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 12 pid: 6691 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.234598:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb35a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d20e expref: 12 pid: 6691 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.234644:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635274.234649:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635274.234713:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 11 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.234725:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 11 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.235629:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 11 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.235650:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1876568422015744:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789635274.235759:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db9593c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789635274.235803:0:8106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 11 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.235816:0:8106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:2.0:1789635274.235850:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+11:10528:x1876568410477568:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 5580us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635274.235859:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1789635274.237713:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1876568422015744:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789635274.237744:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635274.237872:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+10:2348:x1876568410477696:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3381us (3817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635274.237885:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1789635274.242672:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.242891:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410477824 00000100:00100000:2.0:1789635274.242915:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410477824 00002000:00100000:2.0:1789635274.242985:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e79c7b07800 x1876568410477824/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:650/0 lens 504/0 e 0 to 0 dl 1789635285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635274.243000:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79c7b07800 with x1876568410477824 ext(0->12) 00002000:00010000:2.0:1789635274.243007:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79c7b07800 00000100:00100000:2.0:1789635274.243102:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1789635274.243136:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+10:2348:x1876568410477824:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789635274.243861:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+12:2348:x1876568410477824:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 723us (1198us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789635274.243873:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00002000:00100000:2.0:1789635274.243883:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e79c7b07800 x1876568410477824/t4294967308(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:650/0 lens 504/448 e 0 to 0 dl 1789635285 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635274.243894:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79c7b07800 with x1876568410477824 ext(0->12) 00002000:00010000:2.0:1789635274.243899:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79c7b07800 00000100:00100000:3.0:1789635274.246683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.246850:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410477952 00000100:00100000:1.0:1789635274.246863:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410477952 00000100:00100000:1.0:1789635274.246937:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:1.0:1789635274.246951:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+61:10528:x1876568410477952:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789635274.286490:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:1.0:1789635274.286511:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789635274.286551:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789635274.286573:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789635274.286596:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79c7b320c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789635274.286611:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79e7363200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79c7b32480 00000020:00080000:1.0:1789635274.286615:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79e7363600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79c7acc000 00000004:00080000:1.0:1789635274.286713:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789635274.286727:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79c80bb3c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789635274.286731:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79e7363700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79e7eea480 00000020:00080000:1.0:1789635274.286966:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79e7363a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79c7a65400 00000020:00080000:1.0:1789635274.286986:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789635274.287284:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789635274.287565:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422015872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789635274.287649:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635274.287724:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635274.287730:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422016000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789635274.287815:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635274.287857:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422015872 00000100:00100000:0.0:1789635274.287866:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422015872 00000100:00100000:0.0:1789635274.287923:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422016000 00000100:00100000:0.0:1789635274.287926:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422016000 00000100:00100000:0.0:1789635274.287947:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635274.287956:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422015872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789635274.287989:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789635274.288033:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.288062:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 11 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.288073:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789635274.288078:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635274.288084:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635274.288262:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+15:10528:x1876568410477952:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 41313us (41592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.288272:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:2.0:1789635274.288460:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635274.288471:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422016128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789635274.288503:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635274.290061:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 11 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.290086:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 11 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.291101:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422016128 00000100:00100000:2.0:1789635274.291113:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422016128 00000100:00100000:2.0:1789635274.291169:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635274.291180:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422016000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789635274.291441:0:8106:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789635274.291445:0:8106:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789635275 00002000:00010000:2.0:1789635274.291448:0:8106:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789635274.291451:0:8106:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789635275 -> 1789635275 00002000:00010000:2.0:1789635274.291453:0:8106:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789635274.291560:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1876568422016000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 382us (3744us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789635274.291569:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635274.291589:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789635274.291597:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876568422016128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789635274.291636:0:8106:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1789635274.291672:0:8106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aabaaca, atime: 0x6aabaaca, ctime: 0x6aabaaca, blocks: 0x1 00010000:00010000:2.0:1789635274.291681:0:8106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.291699:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=250s v=(0 0) 00010000:00010000:2.0:1789635274.291704:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635274.291712:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.291729:0:8106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.291753:0:8106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.291762:0:8106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.291789:0:8106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789635274.292298:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1876568422016128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 700us (3792us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789635274.292306:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789635274.292358:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789635274.292412:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79c73bd180/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789635274.292418:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422016128:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789635274.292824:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635274.292834:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.292846:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635274.292852:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.292863:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.292884:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.292893:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb35b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.292931:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635274.292934:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635274.292936:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635274.293019:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422016256:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635274.293245:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db959480 going to sleep for 11 seconds 00000004:00080000:0.0:1789635274.293276:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79c72a1180/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789635274.293282:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422016000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789635274.296980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.297274:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422016256:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635274.297354:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.297547:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410478080 00000100:00100000:2.0:1789635274.297576:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410478080 00000100:00100000:2.0:1789635274.297647:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1789635274.297659:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+12:2349:x1876568410478080:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789635274.310112:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635274.310262:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410478208 00000100:00100000:3.0:1789635274.310276:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410478208 00010000:00010000:3.0:1789635274.310366:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 13 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.310412:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:3.0:1789635274.310424:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79da44d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+13:2348:x1876568410478208:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635274.310442:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635274.310449:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 13 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.310486:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 13 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.310514:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001062b57c/0x77332204cfbb3370 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d174 expref: 13 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.310547:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635274.310553:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635274.310560:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.310572:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.310611:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635274.310673:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79da44d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+12:2348:x1876568410478208:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 251us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635274.310682:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00010000:00010000:1.0:1789635274.311353:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.311369:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.311382:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.311392:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.311418:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789635274.312673:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1876568422015872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24711us (25017us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789635274.312687:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1789635274.312923:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635274.312934:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.312949:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635274.312955:0:7641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.312985:0:7641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.313011:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.313020:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb35ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.313053:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635274.313055:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635274.313057:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789635274.313453:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79c72a2300/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789635274.313463:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422015872:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1789635274.343507:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1789635274.343560:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789635274.343568:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789635274.343575:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1789635274.343842:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410478080:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 46177us (46867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.343865:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1789635274.347457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.347585:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410478464 00000100:00100000:2.0:1789635274.347600:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410478464 00000100:00100000:2.0:1789635274.347707:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:2.0:1789635274.347720:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+15:10528:x1876568410478464:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635274.347857:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635274.347895:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d207 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.347922:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:2.0:1789635274.347929:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635274.347966:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.347981:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.347993:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635274.348693:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7bee8d2 reply state 00000000617f18e8 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.348706:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635274.349006:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+16:10528:x1876568410478464:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1287us (1559us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789635274.349016:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00010000:00010000:3.0:1789635274.358831:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.358853:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.358862:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.358870:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635274.358875:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.358884:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.358907:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635274.358928:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635274.358934:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.358942:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb35bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635274.360932:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.361487:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410478592 00000100:00100000:2.0:1789635274.361502:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410478592 00000100:00100000:2.0:1789635274.361592:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:2.0:1789635274.361605:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410478592:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789635274.361879:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789635274.361883:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789635275 -> 1789635275 00002000:00010000:2.0:1789635274.361886:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789635274 00002000:00010000:2.0:1789635274.361889:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789635275 -> 1789635275 00002000:00010000:2.0:1789635274.361891:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789635274.361982:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410478592:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 378us (1060us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789635274.361990:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1789635274.366973:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.367071:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410478848 00000100:00100000:0.0:1789635274.367084:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410478848 00000100:00100000:0.0:1789635274.367170:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:0.0:1789635274.367183:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:10528:x1876568410478848:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789635274.367285:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.367305:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 15 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.367605:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.367651:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 15 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.367669:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 15 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.367686:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422016384:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635274.367809:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db9593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635274.372207:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422016384:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635274.372388:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635274.372779:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635274.372932:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410478976 00000100:00100000:3.0:1789635274.372940:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410478976 00010000:00010000:3.0:1789635274.372987:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.373021:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1789635274.373030:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+16:2349:x1876568410478976:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635274.373043:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635274.373049:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.373059:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.373080:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb357d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1f9 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.373102:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635274.373107:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.373115:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.373137:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.373163:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635274.373225:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:2349:x1876568410478976:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 188us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635274.373239:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00010000:00010000:0.0:1789635274.373481:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373495:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373539:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373546:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373557:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373564:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635274.373569:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373577:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373586:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:0.0:1789635274.373589:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789635274.373593:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.373599:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.373645:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+14:10528:x1876568410478848:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 6464us (6685us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789635274.373652:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:1.0:1789635274.376474:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.376561:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410479104 00000100:00100000:0.0:1789635274.376574:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410479104 00000100:00100000:0.0:1789635274.376636:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:0.0:1789635274.376647:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410479104:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789635274.376706:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.376730:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.376786:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635274.376790:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635274.376794:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.376834:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 7 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.376847:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 7 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.376863:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422016512:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635274.376950:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db9593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635274.378820:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.378841:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422016512:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635274.378872:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.378936:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410479232 00000100:00100000:3.0:1789635274.378945:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410479232 00010000:00010000:3.0:1789635274.378989:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 8 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.379022:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:3.0:1789635274.379034:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410479232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635274.379052:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635274.379078:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 8 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.379148:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 8 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.379171:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a3218cc/0x77332204cfbb35a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d215 expref: 8 pid: 8106 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.379186:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635274.379189:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635274.379199:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.379206:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.379355:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635274.379383:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.379392:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.379412:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410479232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 380us (604us total) trans 0 rc 0/0 00010000:00010000:0.0:1789635274.379419:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.379420:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00010000:00010000:0.0:1789635274.379427:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.379435:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.379442:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635274.379447:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.379458:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.379471:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.379492:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb35ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.379551:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2351:x1876568410479104:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 2907us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.379560:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1789635274.386192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.386255:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410479488 00000100:00100000:0.0:1789635274.386270:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410479488 00000100:00100000:0.0:1789635274.386387:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:0.0:1789635274.386401:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+14:10528:x1876568410479488:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789635274.386837:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.386857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.386868:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.387663:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.387678:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 15 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.387685:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.387737:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 15 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.387753:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 15 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.387772:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422016640:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635274.388579:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db9593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635274.392667:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.392800:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422016640:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635274.392846:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.392916:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410479616 00000100:00100000:3.0:1789635274.392925:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410479616 00010000:00010000:3.0:1789635274.392983:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635274.393063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:3.0:1789635274.393076:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+16:2348:x1876568410479616:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635274.393096:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635274.393103:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.393126:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.393156:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb358b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d200 expref: 16 pid: 7562 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.393175:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635274.393197:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.393206:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.393212:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635274.393254:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635274.393372:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:2348:x1876568410479616:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 297us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635274.393380:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00010000:00010000:0.0:1789635274.393438:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.393446:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635274.393694:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789635274.393846:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789635274.393881:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789635274.393962:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422016768:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789635274.394034:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635274.394062:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7b32780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635274.394644:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422016768 00000100:00100000:1.0:1789635274.394653:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422016768 00000100:00100000:1.0:1789635274.394717:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635274.394727:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876568422016768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789635274.394879:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876568422016768:12345-0@lo:1000:mdt00_001.0 Request processed in 153us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.394887:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635274.396955:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789635274.396972:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1789635274.397000:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79c72a1180, transno 4294967309 00000100:00100000:1.0:1789635274.397031:0:5843:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e79c72a2300 x1876568422015872/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789635290 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635274.397045:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422016768:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789635274.399971:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789635274.400094:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422016896:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789635274.400921:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635274.401046:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db9593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635274.401605:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422016896 00000100:00100000:2.0:1789635274.401617:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422016896 00000100:00100000:2.0:1789635274.401690:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635274.401701:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876568422016896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789635274.402109:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1876568422016896:12345-0@lo:1000:mdt00_001.0 Request processed in 408us (1189us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789635274.402119:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789635274.402292:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876568422016896:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789635274.403235:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403252:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403262:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403269:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635274.403275:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403284:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403302:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d91bae00) 00010000:00010000:1.0:1789635274.403304:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635274.403326:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403334:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb35d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403382:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403387:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403391:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403412:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635274.403415:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403418:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403426:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:1.0:1789635274.403428:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635274.403436:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403449:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403459:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.403503:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635274.403527:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422017024:192.168.201.30@tcp:105: 00000100:00100000:1.0:1789635274.403636:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db9593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635274.408555:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422017024:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789635274.408597:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408632:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb351b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408674:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408691:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408704:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408716:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408723:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408730:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408748:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635274.408752:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408759:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408772:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:0.0:1789635274.408776:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635274.408780:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408792:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb35df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408804:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408811:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408818:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408824:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635274.408827:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408834:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408842:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:0.0:1789635274.408845:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789635274.408848:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.408854:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb35d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635274.409804:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635274.409813:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789635274.410812:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+18:10528:x1876568410479488:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 24403us (24623us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789635274.410827:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 126 00000020:00080000:0.0:1789635274.410856:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789635274.412918:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789635274.412945:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635274.417543:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.417699:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.418606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410479744 00000100:00100000:1.0:1789635274.418622:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410479744 00000100:00100000:1.0:1789635274.418678:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410480000 00000100:00100000:1.0:1789635274.418682:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410480000 00000100:00100000:1.0:1789635274.418702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:1.0:1789635274.418743:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:10527:x1876568410479744:12345-192.168.201.30@tcp:49:lfs.0 00000100:00100000:1.0:1789635274.418931:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:10527:x1876568410479744:12345-192.168.201.30@tcp:49:lfs.0 Request processed in 200us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.418940:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:1.0:1789635274.418961:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1789635274.418968:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+18:10528:x1876568410480000:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789635274.419994:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789635274.420109:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789635274.420173:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.420193:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.420208:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.424867:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.424894:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.424902:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635274.424945:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789635274.425139:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:10528:x1876568410480000:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 6164us (7433us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789635274.425172:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000020:00080000:1.0:1789635274.425180:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789635274.426514:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635274.426539:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.426552:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635274.426557:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.426587:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.426612:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e79d898a400) 00010000:00010000:2.0:1789635274.426616:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789635274.426622:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.426630:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb35e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.426662:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635274.426664:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635274.426666:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635274.431917:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.432074:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410480256 00000100:00100000:1.0:1789635274.432141:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410480256 00000100:00100000:0.0:1789635274.432488:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:0.0:1789635274.432503:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:10527:x1876568410480256:12345-192.168.201.30@tcp:58:lfs.0 00000040:00080000:0.0:1789635274.432977:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789635274.433191:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:10527:x1876568410480256:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 691us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.433201:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:1.0:1789635274.465632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635274.465976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410480384 00000100:00100000:2.0:1789635274.465989:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410480384 00000100:00100000:2.0:1789635274.466061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:2.0:1789635274.466071:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+20:10530:x1876568410480384:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635274.466111:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635274.466136:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb35ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d21c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466207:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466480:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466495:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466537:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466546:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466553:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466884:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466896:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466904:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466947:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.466964:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 21 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635274.466980:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422017152:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635274.467870:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbcce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635274.475443:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.475589:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422017152:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635274.475630:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635274.476116:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410480640 00000100:00100000:1.0:1789635274.476127:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410480640 00000100:00100000:1.0:1789635274.476251:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635274.476264:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+22:5581:x1876568410480640:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789635274.476818:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+23:5581:x1876568410480640:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 555us (1392us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789635274.476827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789635274.481056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635274.481181:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410480768 00000100:00100000:0.0:1789635274.481197:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410480768 00010000:00010000:0.0:1789635274.481602:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 23 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635274.481654:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:0.0:1789635274.481667:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+23:2349:x1876568410480768:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635274.481686:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635274.481695:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 23 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.481713:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 23 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.481866:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb350d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1dd expref: 23 pid: 5844 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.481910:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:0.0:1789635274.481916:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.481928:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.481937:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635274.482038:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635274.482121:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+22:2349:x1876568410480768:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 456us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.482130:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00010000:00010000:2.0:1789635274.484613:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484662:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635274.484726:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789635274.484730:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635274.484758:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484779:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484791:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484799:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484807:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484813:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635274.484818:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484826:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484843:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:2.0:1789635274.484847:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635274.484851:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484866:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb35f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484883:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484888:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484894:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484899:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635274.484902:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484909:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484917:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e79d91f3100) 00010000:00010000:2.0:1789635274.484919:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635274.484922:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484926:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb35fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484969:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb35ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d21c expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484980:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d21c expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635274.484990:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635274.484992:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635274.484994:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820c00, rc 0) 00000100:00100000:2.0:1789635274.485082:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+21:10530:x1876568410480384:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 19011us (19465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635274.485259:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 128 00010000:00010000:1.0:1789635274.771813:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635274.866021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.866083:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.866138:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.866169:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635274.866211:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410480896 00000100:00100000:0.0:1789635274.866716:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410481280 00000100:00100000:0.0:1789635274.866739:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410481280 00000100:00100000:0.0:1789635274.866824:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:0.0:1789635274.866837:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410481280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635274.866939:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410481280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 105us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.866948:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:0.0:1789635274.866979:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410481024 00000100:00100000:0.0:1789635274.866983:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410481024 00000100:00100000:0.0:1789635274.867017:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410481152 00000100:00100000:0.0:1789635274.867020:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410481152 00000100:00100000:0.0:1789635274.867044:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1789635274.867052:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410481024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635274.867119:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410481024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.867127:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1789635274.867140:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1789635274.867147:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2351:x1876568410481152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635274.867200:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2351:x1876568410481152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 53us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635274.867207:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00080000:0.0:1789635274.867239:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635274.867244:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635274.868121:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410480896 00000100:00100000:1.0:1789635274.868193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 268 00000100:00100000:1.0:1789635274.868203:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410480896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635274.868533:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410480896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 330us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635274.868542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 268 00000100:00100000:0.0:1789635275.031619:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422017408:0@lo:400:kworker.0 00000100:00100000:0.0:1789635275.031961:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635275.032032:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635275.032040:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422017536:0@lo:400:kworker.0 00000100:00100000:0.0:1789635275.032064:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635275.032107:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422017408 00000100:00100000:0.0:1789635275.032116:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422017408 00000100:00100000:0.0:1789635275.032163:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422017536 00000100:00100000:0.0:1789635275.032167:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422017536 00000100:00100000:0.0:1789635275.032197:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789635275.032206:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422017408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635275.032267:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422017408:12345-0@lo:400:kworker.0 Request processed in 61us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635275.032274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789635275.032293:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789635275.032300:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422017536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635275.033869:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422017536:12345-0@lo:400:kworker.0 Request processed in 1558us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635275.033882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789635275.033933:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635275.033981:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422017536:0@lo:400:kworker.0 00000100:00100000:0.0:1789635275.033994:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422017408:0@lo:400:kworker.0 00000100:00100000:2.0:1789635275.034744:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422017280:0@lo:400:kworker.0 00000100:00100000:2.0:1789635275.034806:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635275.034865:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635275.034873:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422017664:0@lo:400:kworker.0 00000100:00100000:2.0:1789635275.034900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635275.034934:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422017664 00000100:00100000:2.0:1789635275.034942:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422017664 00000100:00100000:2.0:1789635275.035019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789635275.035028:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422017664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635275.035079:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422017664:12345-0@lo:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635275.035087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789635275.035109:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635275.035131:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422017664:0@lo:400:kworker.0 00000100:00100000:0.0:1789635275.035370:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422017280 00000100:00100000:0.0:1789635275.035375:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422017280 00000100:00100000:0.0:1789635275.035408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789635275.035415:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422017280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635275.035452:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422017280:12345-0@lo:400:kworker.0 Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635275.035459:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789635275.035916:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422017280:0@lo:400:kworker.0 00000100:00100000:1.0:1789635275.036129:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635275.036166:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422017792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635275.036209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635275.036362:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422017792 00000100:00100000:0.0:1789635275.036369:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422017792 00000100:00100000:0.0:1789635275.036822:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789635275.036835:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876568422017792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635275.036862:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789635275.036926:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876568422017792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635275.036933:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789635275.037004:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422017792:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789635275.472576:0:12108:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635275.472594:0:12108:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635275.472648:0:12108:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789635275.472654:0:12108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789635275.477549:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635275.477560:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635275.477626:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789635275.477634:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635275.477800:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422017920:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635275.477942:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbcce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635275.482229:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422017920:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635275.485532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635275.489844:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410481408 00000100:00100000:2.0:1789635275.489862:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410481408 00000100:00100000:2.0:1789635275.489949:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:2.0:1789635275.489961:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:10541:x1876568410481408:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789635275.490013:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789635275.490184:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:10541:x1876568410481408:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 225us (4663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635275.490192:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:2.0:1789635275.498965:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635275.499436:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410481664 00000100:00100000:3.0:1789635275.499454:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410481664 00000100:00100000:3.0:1789635275.499544:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:3.0:1789635275.499568:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+21:10541:x1876568410481664:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635275.499599:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635275.499632:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3609 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d223 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.499888:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.499908:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.499941:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635275.499957:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789635275.500155:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3609 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d223 expref: 24 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.500178:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d223 expref: 23 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.500188:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635275.500192:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635275.500196:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:3.0:1789635275.500437:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+23:10541:x1876568410481664:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 881us (1486us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789635275.500447:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:1.0:1789635275.525227:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635275.525275:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635275.525455:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410481920 00000100:00100000:3.0:1789635275.525470:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410481920 00000100:00100000:3.0:1789635275.525558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:3.0:1789635275.525570:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+23:10541:x1876568410481920:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789635275.525679:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.525700:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.525715:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.526045:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.526054:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.526061:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.526067:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635275.526072:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.526080:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.526095:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635275.526098:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635275.526103:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635275.526110:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb361e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635275.526297:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+24:10541:x1876568410481920:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 728us (1093us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789635275.526307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 131 00000040:00080000:3.0:1789635275.526614:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635275.526620:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635275.527111:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789635275.527134:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635275.528045:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410482048 00000100:00100000:0.0:1789635275.528058:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410482048 00000100:00100000:0.0:1789635275.528130:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1789635275.528142:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:2349:x1876568410482048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635275.528169:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635275.528196:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d223 expref: 24 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635275.528213:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:0.0:1789635275.528218:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635275.528335:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+23:2349:x1876568410482048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 194us (3059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635275.528342:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:3.0:1789635275.533561:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635275.533718:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410482304 00000100:00100000:2.0:1789635275.533732:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410482304 00000100:00100000:2.0:1789635275.534512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:2.0:1789635275.534528:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:10541:x1876568410482304:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789635275.535238:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+24:10541:x1876568410482304:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 712us (1688us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789635275.535248:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000001:00080000:1.0:1789635275.615101:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789635275.615119:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789635275.615124:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1789635275.795836:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635276.820945:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635277.591294:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635277.591305:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635277.592078:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789635277.592087:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789635277.855787:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635278.036206:0:12162:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635278.036223:0:12162:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635278.036277:0:12162:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789635278.036283:0:12162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635278.489573:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635278.489612:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410482560 00000100:00100000:3.0:1789635278.489623:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410482560 00000100:00100000:3.0:1789635278.489685:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:3.0:1789635278.489713:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+24:10563:x1876568410482560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635278.489739:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635278.489761:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d22a expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635278.489865:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb362c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635278.489880:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb362c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635278.489894:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb362c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635278.489905:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789635278.490049:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d22a expref: 27 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635278.490067:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb362c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d22a expref: 26 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635278.490090:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635278.490094:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789635278.490097:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72e00, rc 0) 00000100:00080000:0.0:1789635278.492500:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635278.495553:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+26:10563:x1876568410482560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 5847us (5979us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789635278.495568:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:3.0:1789635278.523003:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635278.523117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410482688 00000100:00100000:2.0:1789635278.523131:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410482688 00000100:00100000:2.0:1789635278.523210:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00100000:2.0:1789635278.523221:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:10563:x1876568410482688:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789635278.523403:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.523427:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.523453:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.523489:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.523497:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.523506:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.523514:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635278.523521:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.523744:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.524433:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:2.0:1789635278.524437:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635278.524454:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.524462:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821c00/0x77332204cfbb363a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635278.524588:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:10563:x1876568410482688:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 1365us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635278.524598:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00100000:0.0:1789635278.611875:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635278.611994:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635278.612238:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018048 00000100:00100000:2.0:1789635278.612262:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018048 00000100:00100000:2.0:1789635278.612389:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789635278.612403:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422018048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635278.612465:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635278.612525:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422018048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635278.612533:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789635278.612775:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635278.612816:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789635278.612823:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789635278.612850:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79c73bd180, transno 4294967304 00000100:00100000:0.0:1789635278.612880:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635278.833531:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635278.833672:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410482816 00000100:00100000:2.0:1789635278.833687:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410482816 00000100:00100000:2.0:1789635278.833783:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1789635278.833797:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410482816:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789635278.833822:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635278.833850:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb3641 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d231 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635278.833910:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aabaacb, atime: 0x6aabaaca, ctime: 0x6aabaacb, blocks: 0xb 00010000:00010000:2.0:1789635278.833936:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=254s v=(0 0) 00010000:00010000:2.0:1789635278.833941:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635278.833952:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb3641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d231 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.833976:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb3641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d231 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635278.833992:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821c00, rc 0) 00000100:00100000:2.0:1789635278.834090:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2350:x1876568410482816:12345-192.168.201.30@tcp:101:cat.0 Request processed in 296us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635278.834098:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00080000:0.0:1789635278.834411:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635278.843481:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635278.843557:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410482944 00000100:00100000:1.0:1789635278.843573:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410482944 00002000:00100000:1.0:1789635278.843652:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9e79e7b67480 x1876568410482944/t0(0) o3->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:654/0 lens 488/0 e 0 to 0 dl 1789635289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789635278.843665:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7b67480 with x1876568410482944 ext(0->4095) 00002000:00010000:1.0:1789635278.843672:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7b67480 00000100:00100000:1.0:1789635278.843711:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:1.0:1789635278.843723:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410482944:12345-192.168.201.30@tcp:3:cat.0 00000100:00100000:1.0:1789635278.844037:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410482944:12345-192.168.201.30@tcp:3:cat.0 Request processed in 316us (571us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789635278.844046:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00002000:00100000:1.0:1789635278.844054:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9e79e7b67480 x1876568410482944/t0(0) o3->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:654/0 lens 488/4536 e 0 to 0 dl 1789635289 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789635278.844063:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7b67480 with x1876568410482944 ext(0->4095) 00002000:00010000:1.0:1789635278.844066:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7b67480 00010000:00010000:1.0:1789635278.872420:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789635279.852848:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967405 is committed 00000001:00080000:1.0:1789635279.852881:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:1.0:1789635279.852896:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79db959240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789635279.852901:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79fdff3a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79c7d72480 00000020:00080000:1.0:1789635279.852904:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79fdff3000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79e7219c00 00000020:00080000:1.0:1789635279.852929:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789635279.852937:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:1.0:1789635279.852946:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789635279.852963:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789635279.853781:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789635279.869063:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789635279.869089:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789635279.869096:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1789635279.895234:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635279.996617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635279.996687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635279.996724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635279.996757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635279.996786:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635279.996789:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483072 00000100:00100000:2.0:1789635279.996803:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483072 00000100:00100000:2.0:1789635279.996881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:2.0:1789635279.996894:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410483072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635279.996921:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483584 00000100:00100000:3.0:1789635279.996927:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483584 00000100:00100000:3.0:1789635279.996982:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483200 00000100:00100000:3.0:1789635279.996986:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483200 00000100:00100000:2.0:1789635279.996990:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410483072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 97us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635279.997000:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:3.0:1789635279.997024:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:3.0:1789635279.997036:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410483584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635279.997071:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:3.0:1789635279.997076:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410483584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635279.997185:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:2348:x1876568410483200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635279.997215:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:2348:x1876568410483200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635279.997270:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483328 00000100:00100000:0.0:1789635279.997275:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483328 00000100:00100000:0.0:1789635279.997337:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483456 00000100:00100000:0.0:1789635279.997341:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483456 00000100:00100000:0.0:1789635279.997367:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789635279.997375:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410483328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635279.997405:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+5:2348:x1876568410483328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635279.997430:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789635279.997443:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:0.0:1789635279.997449:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410483456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635279.997474:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410483456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635279.997479:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00080000:0.0:1789635279.997502:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635279.997508:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635280.006613:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:2.0:1789635280.017217:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:1.0:1789635280.148018:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635280.148051:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422018304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635280.148125:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422018560:0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.148146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635280.148215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635280.148237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422018432:0@lo:400:kworker.0 00000100:00100000:0.0:1789635280.148246:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789635280.148255:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422018176:0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.148270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635280.150386:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422018816:0@lo:400:kworker.0 00000100:00100000:3.0:1789635280.153241:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018304 00000100:00100000:3.0:1789635280.153265:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018304 00000100:00100000:3.0:1789635280.153399:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789635280.153431:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422018304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635280.153490:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635280.162984:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422018944:0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.163112:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635280.163186:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018560 00000100:00100000:1.0:1789635280.163196:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018560 00000100:00100000:1.0:1789635280.163263:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018432 00000100:00100000:1.0:1789635280.163268:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018432 00000100:00100000:1.0:1789635280.163293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018944 00000100:00100000:1.0:1789635280.163297:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018944 00000100:00100000:1.0:1789635280.163336:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789635280.163347:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.163423:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422018560:12345-0@lo:400:kworker.0 Request processed in 66us (15196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635280.163430:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789635280.163449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635280.163456:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422018432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.163503:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422018432:12345-0@lo:400:kworker.0 Request processed in 47us (15234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635280.163509:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789635280.163521:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789635280.163527:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422018944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.163554:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422018944:12345-0@lo:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635280.163560:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789635280.163606:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422018432:0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.164121:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422018944:0@lo:400:kworker.0 00000100:00080000:1.0:1789635280.164193:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635280.164199:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635280.166759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635280.166854:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422018688:0@lo:400:kworker.0 00000100:00100000:0.0:1789635280.168133:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635280.168194:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018688 00000100:00100000:0.0:1789635280.168206:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018688 00000100:00100000:0.0:1789635280.168294:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789635280.168305:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422018688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635280.168387:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422018688:12345-0@lo:400:kworker.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635280.168395:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789635280.168436:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635280.168482:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422018688:0@lo:400:kworker.0 00000100:00100000:0.0:1789635280.168497:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422018560:0@lo:400:kworker.0 00000100:00100000:2.0:1789635280.172758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635280.175215:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018176 00000100:00100000:1.0:1789635280.175236:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018176 00000100:00100000:1.0:1789635280.175331:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789635280.175344:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422018176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635280.175476:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422018176:12345-0@lo:400:kworker.0 Request processed in 134us (8723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635280.175512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789635280.178256:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422018816 00000100:00100000:0.0:1789635280.178276:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422018816 00000100:00100000:0.0:1789635280.178398:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635280.178409:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422018816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635280.178558:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422018816:12345-0@lo:400:kworker.0 Request processed in 151us (5812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635280.178566:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635280.178626:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422018176:0@lo:400:kworker.0 00000100:00100000:2.0:1789635280.178802:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789635280.178810:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79c72a2300, transno 4294967310 00000004:00080000:2.0:1789635280.178828:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789635280.178850:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422018816:0@lo:400:kworker.0 00000100:00100000:3.0:1789635280.183430:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422018304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29999us (35262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635280.183455:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789635280.196455:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422018304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789635280.918899:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635281.954009:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635282.964042:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635283.731688:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422019072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635283.731755:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635283.731903:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019072 00000100:00100000:1.0:1789635283.731913:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019072 00000100:00100000:1.0:1789635283.731980:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789635283.731990:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422019072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635283.732023:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635283.732066:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422019072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635283.732072:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789635283.732410:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635283.732443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422019072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789635283.987757:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789635284.937628:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789635284.937690:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789635284.937703:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789635285.017961:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635285.104301:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635285.104368:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635285.104395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635285.104422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635285.104459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635285.104498:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410484224 00000100:00100000:3.0:1789635285.104508:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410484224 00000100:00100000:3.0:1789635285.104588:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483840 00000100:00100000:3.0:1789635285.104592:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483840 00000100:00100000:3.0:1789635285.104616:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:3.0:1789635285.104628:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410484224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635285.104717:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410484224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635285.104725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:3.0:1789635285.104743:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:3.0:1789635285.104752:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+13:2349:x1876568410483840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635285.104777:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+13:2349:x1876568410483840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635285.104784:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:3.0:1789635285.104810:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483968 00000100:00100000:3.0:1789635285.104814:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483968 00000100:00100000:3.0:1789635285.104839:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410484096 00000100:00100000:3.0:1789635285.104842:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410484096 00000100:00100000:3.0:1789635285.104875:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1789635285.104883:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410483968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635285.104911:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410483968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635285.104918:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1789635285.104944:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1789635285.104953:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410484096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635285.104977:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410484096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635285.104984:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00080000:3.0:1789635285.104999:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635285.105004:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635285.105006:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635285.106247:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410483712 00000100:00100000:2.0:1789635285.106257:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410483712 00000100:00100000:2.0:1789635285.106305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:2.0:1789635285.106341:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410483712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635285.106393:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410483712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 79us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635285.106400:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:2.0:1789635285.272694:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422019584:0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.272765:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635285.272822:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789635285.272829:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422019200:0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.272871:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635285.272891:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422019712:0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.272911:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635285.272945:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422019328:0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.272972:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635285.272989:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422019840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.273010:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635285.273028:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635285.273033:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422019456:0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.273053:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635285.273494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019200 00000100:00100000:1.0:1789635285.273503:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019200 00000100:00100000:1.0:1789635285.273546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789635285.273556:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422019200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635285.273611:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422019200:12345-0@lo:400:kworker.0 Request processed in 57us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635285.273618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789635285.273678:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422019200:0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.275571:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635285.275587:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422019968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635285.275646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635285.278886:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019328 00000100:00100000:0.0:1789635285.278900:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019328 00000100:00100000:0.0:1789635285.278985:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019840 00000100:00100000:0.0:1789635285.278989:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019840 00000100:00100000:3.0:1789635285.279094:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019968 00000100:00100000:3.0:1789635285.279099:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019968 00000100:00100000:3.0:1789635285.279156:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789635285.279168:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422019968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635285.279205:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635285.279285:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422019968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635285.279292:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635285.279895:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019456 00000100:00100000:2.0:1789635285.279901:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019456 00000100:00100000:2.0:1789635285.279925:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789635285.279932:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422019328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.279974:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422019328:12345-0@lo:400:kworker.0 Request processed in 42us (7000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635285.279980:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789635285.279993:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789635285.280000:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422019840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.280028:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422019840:12345-0@lo:400:kworker.0 Request processed in 29us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635285.280034:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789635285.280044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789635285.280050:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422019456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635285.280088:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422019456:12345-0@lo:400:kworker.0 Request processed in 39us (7034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635285.280104:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1789635285.291738:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635285.291747:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635285.293465:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019584 00000100:00100000:0.0:1789635285.293479:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019584 00000100:00100000:0.0:1789635285.293534:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422019712 00000100:00100000:0.0:1789635285.293538:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422019712 00000100:00100000:0.0:1789635285.293560:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789635285.293570:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422019584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635285.293670:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422019584:12345-0@lo:400:kworker.0 Request processed in 101us (20905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635285.293677:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789635285.293695:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789635285.293701:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422019712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635285.293740:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422019712:12345-0@lo:400:kworker.0 Request processed in 39us (20827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635285.293746:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789635285.293822:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422019968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635285.293837:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422019456:0@lo:400:kworker.0 00000100:00100000:0.0:1789635285.293849:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422019328:0@lo:400:kworker.0 00000100:00100000:0.0:1789635285.293861:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422019840:0@lo:400:kworker.0 00000100:00080000:0.0:1789635285.293901:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635285.296632:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422019712:0@lo:400:kworker.0 00000100:00100000:1.0:1789635285.296649:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422019584:0@lo:400:kworker.0 00010000:00010000:3.0:1789635286.050671:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635287.062483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789635287.892890:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635287.892900:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635287.893698:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789635287.893707:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789635288.091786:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635288.851661:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422020096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635288.851754:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635288.851922:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020096 00000100:00100000:0.0:1789635288.851932:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020096 00000100:00100000:0.0:1789635288.852004:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789635288.852014:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422020096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635288.852062:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635288.852125:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422020096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635288.852131:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789635288.852504:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635288.852546:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422020096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789635289.112909:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635289.632940:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635289.634805:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410484352 00000100:00100000:2.0:1789635289.634822:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410484352 00000100:00100000:2.0:1789635289.634915:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:2.0:1789635289.634929:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+13:10207:x1876568410484352:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789635289.635067:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+13:10207:x1876568410484352:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 142us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635289.635075:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00080000:1.0:1789635289.635220:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635289.646657:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635289.646743:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410484608 00000100:00100000:2.0:1789635289.646755:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410484608 00000100:00100000:2.0:1789635289.646818:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:2.0:1789635289.646829:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+13:10207:x1876568410484608:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789635289.647609:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+14:10207:x1876568410484608:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 776us (958us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789635289.647618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000001:00080000:2.0:1789635289.952628:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:3.0:1789635290.131772:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635290.242584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635290.242647:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635290.242687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635290.242742:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635290.243029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410484736 00000100:00100000:1.0:1789635290.243040:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410484736 00000100:00100000:1.0:1789635290.243106:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:1.0:1789635290.243116:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410484736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635290.243182:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410484736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 67us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635290.243189:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:0.0:1789635290.243574:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410484864 00000100:00100000:0.0:1789635290.243580:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410484864 00000100:00100000:0.0:1789635290.243634:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410484992 00000100:00100000:0.0:1789635290.243638:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410484992 00000100:00100000:0.0:1789635290.243661:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1789635290.243669:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410484864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635290.243729:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410484864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 60us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635290.243746:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1789635290.243760:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1789635290.243776:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410484992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635290.243802:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410484992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635290.243808:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00080000:1.0:1789635290.244489:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635290.244494:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635290.244612:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410485120 00000100:00100000:2.0:1789635290.244618:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410485120 00000100:00100000:2.0:1789635290.244674:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:2.0:1789635290.244682:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410485120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635290.244757:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410485120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (2109us total) trans 0 rc 0/0 00000100:00080000:1.0:1789635290.245156:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635290.245446:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:1.0:1789635290.388278:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422020608:0@lo:400:kworker.0 00000100:00100000:0.0:1789635290.388278:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422020352:0@lo:400:kworker.0 00000100:00100000:3.0:1789635290.388449:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422020224:0@lo:400:kworker.0 00000100:00100000:0.0:1789635290.392727:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635290.392832:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422020864:0@lo:400:kworker.0 00000100:00100000:0.0:1789635290.392879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635290.392925:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789635290.392938:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422020480:0@lo:400:kworker.0 00000100:00100000:2.0:1789635290.392950:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020352 00000100:00100000:2.0:1789635290.392965:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020352 00000100:00100000:0.0:1789635290.392974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635290.393016:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422020992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635290.393037:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020864 00000100:00100000:2.0:1789635290.393043:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020864 00000100:00100000:0.0:1789635290.393054:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635290.393107:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020480 00000100:00100000:2.0:1789635290.393111:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020480 00000100:00100000:2.0:1789635290.393135:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789635290.393145:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422020352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635290.393262:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422020352:12345-0@lo:400:kworker.0 Request processed in 117us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635290.393269:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789635290.393286:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789635290.393293:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422020864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635290.393372:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635290.393380:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422020864:12345-0@lo:400:kworker.0 Request processed in 85us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635290.393391:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789635290.393409:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789635290.393416:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422020480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635290.393566:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020992 00000100:00100000:0.0:1789635290.393578:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020992 00000100:00100000:0.0:1789635290.393634:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789635290.393642:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422020992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635290.393691:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789635290.393754:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635290.393760:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635290.393773:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020608 00000100:00100000:1.0:1789635290.393778:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020608 00000100:00100000:1.0:1789635290.393819:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789635290.393826:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422020608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635290.399361:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422020480:12345-0@lo:400:kworker.0 Request processed in 5933us (6381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635290.399365:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422020992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5713us (6302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635290.399394:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789635290.399509:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422020480:0@lo:400:kworker.0 00000100:00100000:0.0:1789635290.399532:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789635290.399541:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422020992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635290.399569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422020352:0@lo:400:kworker.0 00000100:00100000:2.0:1789635290.399584:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422020864:0@lo:400:kworker.0 00000100:00100000:1.0:1789635290.400037:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422020608:12345-0@lo:400:kworker.0 Request processed in 6208us (6668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635290.400048:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789635290.400742:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635290.400812:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422020736:0@lo:400:kworker.0 00000100:00100000:3.0:1789635290.400859:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635290.400894:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020736 00000100:00100000:3.0:1789635290.400905:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020736 00000100:00100000:3.0:1789635290.400971:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635290.400983:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422020736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635290.401045:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422020736:12345-0@lo:400:kworker.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635290.401051:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635290.401094:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422020736:0@lo:400:kworker.0 00000100:00100000:1.0:1789635290.401395:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422020224 00000100:00100000:1.0:1789635290.401400:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422020224 00000100:00100000:1.0:1789635290.401561:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789635290.401569:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422020224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635290.401609:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422020224:12345-0@lo:400:kworker.0 Request processed in 41us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635290.401615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789635290.401703:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422020224:0@lo:400:kworker.0 00000100:00100000:0.0:1789635290.401783:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422020608:0@lo:400:kworker.0 00000100:00080000:2.0:1789635290.410035:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635291.155794:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635292.189922:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635293.204157:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635294.008743:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635294.008772:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422021120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635294.008859:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635294.010861:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422021120 00000100:00100000:0.0:1789635294.010877:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422021120 00000100:00100000:0.0:1789635294.010952:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789635294.010964:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422021120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635294.011006:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635294.011083:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422021120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635294.011091:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789635294.011159:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422021120:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789635294.056152:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789635294.251580:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635294.382671:0:12368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:54:52 (1789635292) 00010000:00010000:1.0:1789635295.316003:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635295.395741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635295.395789:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635295.395821:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635295.395853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635295.395873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635295.395904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410485376 00000100:00100000:3.0:1789635295.395914:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410485376 00000100:00100000:2.0:1789635295.395938:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410485504 00000100:00100000:2.0:1789635295.395943:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410485504 00000100:00100000:3.0:1789635295.395983:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410485760 00000100:00100000:2.0:1789635295.395983:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410485632 00000100:00100000:3.0:1789635295.395986:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410485760 00000100:00100000:2.0:1789635295.395986:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410485632 00000100:00100000:3.0:1789635295.396008:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1789635295.396008:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:3.0:1789635295.396018:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:2348:x1876568410485376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635295.396018:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410485632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635295.396113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410485248 00000100:00100000:1.0:1789635295.396118:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410485248 00000100:00100000:1.0:1789635295.396162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:1.0:1789635295.396170:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410485248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635295.396230:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:2348:x1876568410485376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 214us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635295.396250:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:3.0:1789635295.396266:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1789635295.396273:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410485760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635295.396484:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1789635295.396494:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2347:x1876568410485504:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1789635295.396515:0:6694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb303d 00000100:00080000:0.0:1789635295.396525:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5f7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635295.396565:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:2.0:1789635295.398067:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410485632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2045us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635295.398077:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00080000:2.0:1789635295.398107:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635295.398112:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635295.398115:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789635295.398475:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635295.406839:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410485248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 10656us (11096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635295.406856:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:3.0:1789635295.415572:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410485760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19286us (19683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635295.415588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:0.0:1789635295.416515:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+2:2347:x1876568410485504:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 20017us (20719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635295.416526:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789635295.507687:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422021504:0@lo:400:kworker.0 00000100:00100000:2.0:1789635295.507738:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422021632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635295.507758:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635295.507787:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422021504 00000100:00100000:2.0:1789635295.507795:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422021504 00000100:00100000:3.0:1789635295.507818:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422022016:0@lo:400:kworker.0 00000100:00100000:3.0:1789635295.507838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635295.507842:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789635295.507851:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422021504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635295.507862:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789635295.507867:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422021376:0@lo:400:kworker.0 00000100:00100000:1.0:1789635295.507948:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422022016 00000100:00100000:1.0:1789635295.507953:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422022016 00000100:00100000:1.0:1789635295.507984:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789635295.507990:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422022016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635295.508185:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422021248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635295.510838:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422021504:12345-0@lo:400:kworker.0 Request processed in 2981us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635295.510852:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1789635295.510896:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635295.510930:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635295.511051:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422021632 00000100:00100000:2.0:1789635295.511058:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422021632 00000100:00100000:2.0:1789635295.511090:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789635295.511097:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422021632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635295.511405:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422021632:12345-0@lo:400:kworker.0 Request processed in 307us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635295.511413:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789635295.511430:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635295.511457:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422021632:0@lo:400:kworker.0 00000100:00100000:3.0:1789635295.527119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635295.527276:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422021376 00000100:00100000:3.0:1789635295.527287:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422021376 00000100:00100000:3.0:1789635295.527538:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789635295.527552:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422021376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635295.527627:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422021376:12345-0@lo:400:kworker.0 Request processed in 79us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635295.527652:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789635295.528056:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422022016:12345-0@lo:400:kworker.0 Request processed in 20064us (20214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635295.528065:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789635295.530557:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422021376:0@lo:400:kworker.0 00000100:00100000:2.0:1789635295.530572:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422021888:0@lo:400:kworker.0 00000100:00100000:2.0:1789635295.530628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635295.530671:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422021504:0@lo:400:kworker.0 00000100:00100000:2.0:1789635295.530682:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422022016:0@lo:400:kworker.0 00000100:00100000:0.0:1789635295.531387:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635295.531410:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422021760:0@lo:400:kworker.0 00000100:00100000:0.0:1789635295.531430:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635295.531466:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422021888 00000100:00100000:0.0:1789635295.531484:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422021888 00000100:00100000:0.0:1789635295.531529:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422021760 00000100:00100000:0.0:1789635295.531532:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422021760 00000100:00100000:0.0:1789635295.531550:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789635295.531557:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422021888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635295.531604:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422021888:12345-0@lo:400:kworker.0 Request processed in 48us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635295.531611:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789635295.531624:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789635295.531630:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422021760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635295.531660:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422021760:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635295.531666:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1789635295.531681:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635295.531704:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422021760:0@lo:400:kworker.0 00000100:00100000:2.0:1789635295.532521:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422021888:0@lo:400:kworker.0 00000100:00100000:3.0:1789635295.534236:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422021248 00000100:00100000:3.0:1789635295.534247:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422021248 00000100:00100000:3.0:1789635295.534348:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789635295.534370:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422021248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635295.534407:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635295.534483:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422021248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635295.534490:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789635295.535374:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422021248:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789635296.108203:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:1.0:1789635296.108212:0:6717:0:(genops.c:885:class_export_put()) final put ffff9e79fe5f7000/e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:3.0:1789635296.108557:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe5f7000/e05ee327-d920-4885-acb2-a26d789e134c for lustre-OST0000 00000020:00000080:0.0:1789635296.108685:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fe5f7800 for lustre-OST0000 00010000:00010000:2.0:1789635296.339643:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635296.948414:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635296.948866:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410486016 00000100:00100000:2.0:1789635296.948878:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410486016 00000100:00100000:2.0:1789635296.949043:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:2.0:1789635296.949054:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+13:11274:x1876568410486016:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635296.949076:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635296.949097:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3648 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d238 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.949190:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.949205:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.949214:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.949227:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950382:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950394:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950666:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb365d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950676:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb365d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950683:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb365d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635296.950694:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789635296.950842:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950850:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950864:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950872:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635296.950876:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950884:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950897:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e79d91f3900) 00010000:00010000:2.0:1789635296.950900:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635296.950905:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950911:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb364f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950936:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950941:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950946:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950951:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635296.950953:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950969:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950977:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e79d91f3400) 00010000:00010000:2.0:1789635296.950979:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635296.950982:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.950987:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3656 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.953461:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3648 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d238 expref: 16 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.953488:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb365d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d238 expref: 15 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635296.953497:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:2.0:1789635296.953500:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635296.953503:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635296.959458:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+15:11274:x1876568410486016:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 10392us (11040us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789635296.959471:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:2.0:1789635296.965570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635296.965645:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410486144 00000100:00100000:0.0:1789635296.965656:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410486144 00000100:00100000:0.0:1789635296.965727:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1789635296.965738:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+15:2348:x1876568410486144:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635296.965753:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635296.965779:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb365d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d238 expref: 15 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635296.965796:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:0.0:1789635296.965802:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635296.965879:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:2348:x1876568410486144:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 142us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635296.965886:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789635296.969874:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635296.970056:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410486272 00000100:00100000:3.0:1789635296.970065:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410486272 00000100:00100000:3.0:1789635296.970139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:3.0:1789635296.970151:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:11274:x1876568410486272:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789635296.970268:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:11274:x1876568410486272:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635296.970275:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 136 00000040:00080000:1.0:1789635297.173812:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635297.173823:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635297.174408:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1789635297.174419:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789635297.364509:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635298.387443:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635299.092939:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635299.092961:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422022144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635299.093023:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635299.093103:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422022144 00000100:00100000:2.0:1789635299.093110:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422022144 00000100:00100000:2.0:1789635299.093159:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789635299.093167:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422022144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635299.093213:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635299.093251:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422022144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635299.093257:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789635299.093276:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635299.093339:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422022144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789635299.412307:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635300.141501:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635300.142253:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410486400 00000100:00100000:3.0:1789635300.142264:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410486400 00000100:00080000:0.0:1789635300.142353:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635300.142366:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:3.0:1789635300.142377:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+14:11317:x1876568410486400:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635300.142396:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635300.142418:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb366b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d23f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.142499:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.142512:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.142524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.142540:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.142547:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.142553:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143037:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143047:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143054:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143075:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635300.143080:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143098:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143114:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:3.0:1789635300.143117:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635300.143123:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143130:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143141:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143148:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143154:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143275:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635300.143278:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143284:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143292:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e79d91ba500) 00010000:00010000:3.0:1789635300.143295:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635300.143297:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143328:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143366:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb366b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d23f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143378:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:3.0:1789635300.143380:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635300.143384:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb366b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d23f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.143393:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72800, rc 0) 00000100:00100000:3.0:1789635300.143459:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+14:11317:x1876568410486400:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1084us (1969us total) trans 0 rc 301/301 00000100:00100000:3.0:1789635300.143467:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:0.0:1789635300.153283:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635300.153433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410486656 00000100:00100000:3.0:1789635300.153448:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410486656 00000100:00100000:3.0:1789635300.153514:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 138 00000100:00100000:3.0:1789635300.153525:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+14:11317:x1876568410486656:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:3.0:1789635300.153585:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635300.153611:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb2ff7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d07f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.153628:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:3.0:1789635300.153638:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635300.153852:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.154104:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.154114:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.154128:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.154134:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.154139:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635300.155856:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789635300.155883:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.155892:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.155899:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.155905:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635300.155910:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.155917:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.155945:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91ba500) 00010000:00010000:3.0:1789635300.155948:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635300.155952:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.155959:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3680 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635300.155975:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1806116 reply state 000000008c8bbd47 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635300.155984:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635300.156172:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+15:11317:x1876568410486656:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 2646us (2896us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789635300.156181:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 138 00000001:00080000:3.0:1789635300.161098:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1789635300.166065:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.166086:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.166095:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.166102:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635300.166107:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.166115:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.166146:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e79d91bab00) 00010000:00010000:3.0:1789635300.166149:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635300.166153:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.166159:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3687 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635300.211351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635300.211388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410486784 00000100:00100000:3.0:1789635300.211398:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410486784 00000100:00100000:3.0:1789635300.211448:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:3.0:1789635300.211459:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+13:11325:x1876568410486784:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:3.0:1789635300.211484:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635300.211506:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb368e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d246 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.211572:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3695 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.211586:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3695 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.211600:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3695 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635300.211634:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635300.211638:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635300.211660:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3695 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.211697:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb368e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d246 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.211713:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3695 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d246 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.211722:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635300.211725:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635300.211728:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72800, rc 0) 00000100:00100000:3.0:1789635300.211784:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+14:11325:x1876568410486784:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 325us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635300.211791:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:1.0:1789635300.249172:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.249240:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410486912 00000100:00100000:0.0:1789635300.249251:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410486912 00000100:00100000:0.0:1789635300.249350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:0.0:1789635300.249361:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+14:11331:x1876568410486912:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635300.249383:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635300.249405:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb369c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d24d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249474:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249489:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249500:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249516:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249524:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249530:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249877:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb36b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249886:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb36b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249892:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb36b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635300.249918:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789635300.249922:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635300.249942:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb36b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249953:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249960:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249966:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249972:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635300.249977:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249985:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.249996:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:0.0:1789635300.250005:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635300.250011:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250017:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb36a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250028:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250034:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250039:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250044:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635300.250047:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250052:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250074:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e79d088e300) 00010000:00010000:0.0:1789635300.250077:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635300.250080:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250086:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb36aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250116:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb369c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d24d expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250140:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb36b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d24d expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.250147:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635300.250149:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789635300.250152:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031400, rc 0) 00000100:00100000:0.0:1789635300.250208:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+15:11331:x1876568410486912:12345-192.168.201.30@tcp:101:bash.0 Request processed in 850us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.250216:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:3.0:1789635300.252825:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.252877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410487168 00000100:00100000:0.0:1789635300.252888:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410487168 00000100:00100000:0.0:1789635300.252944:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:0.0:1789635300.252954:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+15:11331:x1876568410487168:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635300.252975:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635300.252995:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb36b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d254 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.253131:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.253146:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.253157:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.255367:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.255406:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.255418:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635300.256089:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789635300.256541:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256553:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256564:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256676:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256684:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256691:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256698:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635300.256703:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256710:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256734:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635300.256738:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635300.256742:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256749:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb36bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635300.256763:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071728fc8 reply state 000000009fe8e547 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635300.256771:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789635300.256809:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb36b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256824:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.256832:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e300) 00010000:00010000:0.0:1789635300.256834:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635300.256836:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030a00, rc 0) 00000100:00100000:0.0:1789635300.256988:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+18:11331:x1876568410487168:12345-192.168.201.30@tcp:101:bash.0 Request processed in 4016us (4151us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789635300.257015:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 141 00010000:00010000:1.0:1789635300.258789:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.258805:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.258811:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.258817:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635300.258821:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.258828:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.258842:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d088e700) 00010000:00010000:1.0:1789635300.258846:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635300.258849:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.258854:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb36c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635300.261549:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.262163:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410487296 00000100:00100000:0.0:1789635300.262176:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410487296 00000100:00100000:0.0:1789635300.262292:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1789635300.262300:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1876568410487296:12345-192.168.201.30@tcp:8:bash.0 00010000:00080000:0.0:1789635300.262380:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1789635300.262410:0:6691:0:(genops.c:1384:class_connect()) connect: client e05ee327-d920-4885-acb2-a26d789e134c, cookie 0x77332204cfbb36db 00002000:00100000:0.0:1789635300.262422:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e05ee327-d920-4885-acb2-a26d789e134c/ffff9e79e73f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635300.262448:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635300.262908:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789635300.262943:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e79e73f4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635300.263022:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2347:x1876568410487296:12345-192.168.201.30@tcp:8:bash.0 Request processed in 710us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.263031:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:3.0:1789635300.264434:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.264751:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410487424 00000100:00100000:2.0:1789635300.264765:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410487424 00000100:00100000:0.0:1789635300.264939:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1789635300.264953:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:0:x1876568410487424:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635300.264971:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635300.264993:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d25b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635300.265118:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635300.265137:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=276s v=(0 0) 00010000:00010000:0.0:1789635300.265142:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635300.265152:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.265173:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.265187:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635300.265252:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:0:x1876568410487424:12345-192.168.201.30@tcp:101:bash.0 Request processed in 303us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.265259:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00080000:3.0:1789635300.266152:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635300.267905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.267985:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410487552 00000100:00100000:0.0:1789635300.267997:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410487552 00000100:00100000:0.0:1789635300.268129:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:0.0:1789635300.268141:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:11331:x1876568410487552:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635300.268160:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635300.268178:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d262 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.268208:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.268217:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635300.268222:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635300.268226:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.268258:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.268271:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 8 pid: 6691 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635300.268285:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1876568422022272:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635300.268412:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafde40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635300.270772:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1876568422022272:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635300.270807:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.270830:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031000, rc 0) 00000100:00100000:0.0:1789635300.270892:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:11331:x1876568410487552:12345-192.168.201.30@tcp:101:bash.0 Request processed in 2753us (2995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.270901:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:1.0:1789635300.271258:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635300.271342:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410487680 00000100:00100000:3.0:1789635300.271349:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410487680 00010000:00010000:3.0:1789635300.271383:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 8 pid: 6691 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635300.271501:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1789635300.271512:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79d00c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410487680:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635300.271527:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635300.271552:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 8 pid: 6691 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.271583:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 8 pid: 6691 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.271608:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb36e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d25b expref: 8 pid: 6691 timeout: 376 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.271621:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635300.271626:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635300.271633:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.271644:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.271680:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635300.271706:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e71b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876568422022400:192.168.201.30@tcp:105: 00000100:00100000:3.0:1789635300.271768:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635300.273396:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e71b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876568422022400:192.168.201.30@tcp:105: 00010000:00010000:1.0:1789635300.273420:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635300.273463:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79d00c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410487680:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1952us (2205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635300.273478:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1789635300.274500:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.274589:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410487936 00000100:00100000:2.0:1789635300.274598:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410487936 00000100:00100000:2.0:1789635300.274701:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:2.0:1789635300.274712:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+17:11331:x1876568410487936:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1789635300.275042:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+18:11331:x1876568410487936:12345-192.168.201.30@tcp:35:bash.0 Request processed in 332us (546us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789635300.275050:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1789635300.335691:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.335795:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410488192 00000100:00100000:2.0:1789635300.335806:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410488192 00000100:00100000:2.0:1789635300.335908:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:2.0:1789635300.335921:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:11341:x1876568410488192:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635300.335949:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635300.335970:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb36f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d269 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635300.336093:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789635300.336279:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb36f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d269 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.336296:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:2.0:1789635300.336299:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635300.336305:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb36f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d269 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.336343:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635300.336411:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+19:11341:x1876568410488192:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 492us (729us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789635300.336419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:3.0:1789635300.341264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.341423:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410488448 00000100:00100000:1.0:1789635300.341433:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410488448 00000100:00100000:1.0:1789635300.341489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1789635300.341500:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+19:11341:x1876568410488448:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789635300.341742:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:11341:x1876568410488448:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 243us (486us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789635300.341751:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1789635300.403990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635300.404103:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410488576 00000100:00100000:3.0:1789635300.404113:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410488576 00000100:00100000:3.0:1789635300.404164:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:3.0:1789635300.404172:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+20:11347:x1876568410488576:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635300.404206:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635300.404433:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb36fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d270 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.404492:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.404503:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.404512:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635300.404538:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789635300.404540:0:7562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635300.404552:0:7562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.404570:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb36fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d270 expref: 22 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.404583:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d270 expref: 21 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.404591:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:3.0:1789635300.404595:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635300.404598:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73000, rc 0) 00000100:00100000:3.0:1789635300.404708:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+21:11347:x1876568410488576:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 536us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635300.404714:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:3.0:1789635300.407327:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.407426:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410488832 00000100:00100000:0.0:1789635300.407436:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410488832 00000100:00100000:0.0:1789635300.407483:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:0.0:1789635300.407490:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:11347:x1876568410488832:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635300.407508:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635300.407525:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb370c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d277 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.407605:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.407618:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.407630:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635300.407642:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789635300.407768:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb370c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d277 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.407781:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d277 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.407788:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e300) 00010000:00010000:0.0:1789635300.407790:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635300.407792:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030800, rc 0) 00000100:00100000:0.0:1789635300.407881:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+23:11347:x1876568410488832:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 389us (574us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789635300.407887:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:2.0:1789635300.410597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.410674:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635300.410734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410489216 00000100:00100000:3.0:1789635300.410744:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410489216 00000100:00100000:3.0:1789635300.410791:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 145 00000100:00100000:3.0:1789635300.410798:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:11347:x1876568410489216:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635300.410818:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635300.410834:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3721 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d27e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.410920:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3728 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.410933:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3728 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.410943:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3728 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635300.410952:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789635300.411068:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3721 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d27e expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.411086:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3728 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d27e expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.411095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e300) 00010000:00010000:3.0:1789635300.411098:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789635300.411101:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73c00, rc 0) 00000100:00100000:3.0:1789635300.411150:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+25:11347:x1876568410489216:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 353us (476us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789635300.411166:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 145 00000100:00100000:0.0:1789635300.414118:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410488960 00000100:00100000:0.0:1789635300.414132:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410488960 00000100:00100000:0.0:1789635300.414202:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789635300.414209:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+25:2349:x1876568410488960:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635300.414234:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635300.414260:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d277 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.414290:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e300) 00010000:00010000:0.0:1789635300.414294:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635300.414363:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+24:2349:x1876568410488960:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 154us (3777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.414369:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789635300.415835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.415915:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410489344 00000100:00100000:1.0:1789635300.415923:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410489344 00000100:00100000:1.0:1789635300.415974:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1789635300.415983:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410489344:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:1.0:1789635300.416026:0:8106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.416045:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.416064:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635300.416068:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635300.416086:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.416124:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.416140:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 7 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635300.416156:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422022528:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635300.416232:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635300.418159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.418217:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410489472 00000100:00100000:0.0:1789635300.418226:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410489472 00002000:00100000:0.0:1789635300.418289:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e79e7243480 x1876568410489472/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:676/0 lens 504/0 e 0 to 0 dl 1789635311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635300.418297:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7243480 with x1876568410489472 ext(0->12) 00010000:00010000:0.0:1789635300.418305:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 8 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.418356:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 8 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635300.418365:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79e7243480 00000100:00100000:0.0:1789635300.418391:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1789635300.418401:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410489472:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:1.0:1789635300.420173:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422022528:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635300.420199:0:8106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.436703:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789635300.442760:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000100:00100000:0.0:1789635300.443694:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:2348:x1876568410489472:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 25275us (25521us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789635300.443711:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00002000:00100000:0.0:1789635300.443726:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e79e7243480 x1876568410489472/t4294967305(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:676/0 lens 504/448 e 0 to 0 dl 1789635311 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789635300.443737:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7243480 with x1876568410489472 ext(0->12) 00010000:00010000:0.0:1789635300.443749:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 9 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.443769:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 9 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635300.443777:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79e7243480 00000100:00100000:1.0:1789635300.446111:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635300.446153:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410489600 00000100:00100000:3.0:1789635300.446164:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410489600 00010000:00010000:3.0:1789635300.446205:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 9 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635300.446249:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1789635300.446259:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:2351:x1876568410489600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635300.446276:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789635300.446297:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789635300.446300:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789635301 00002000:00010000:3.0:1789635300.446302:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789635301 00002000:00010000:3.0:1789635300.446304:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789635301 00010000:00010000:3.0:1789635300.446349:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 9 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.446367:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 9 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.446392:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb36e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d262 expref: 9 pid: 6694 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.446409:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635300.446414:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635300.446421:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.446444:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.446553:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635300.446614:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2351:x1876568410489600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 354us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.446622:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00010000:00010000:1.0:1789635300.447536:0:8106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447547:0:8106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447570:0:8106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447588:0:8106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447597:0:8106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447604:0:8106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635300.447609:0:8106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447618:0:8106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447631:0:8106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.447637:0:8106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13e3852/0x77332204cfbb3736 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635300.447741:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410489344:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 31758us (31909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635300.447748:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:2.0:1789635300.449439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.449495:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410489856 00000100:00100000:1.0:1789635300.449504:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410489856 00000100:00100000:1.0:1789635300.449544:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:1.0:1789635300.449561:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d32450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+24:11347:x1876568410489856:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:1.0:1789635300.449620:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3728 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d27e expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635300.449872:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789635300.449921:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789635300.450639:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789635300.450699:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.450715:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.450724:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.450758:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635300.450773:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 28 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635300.450787:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1876568422022656:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635300.450886:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635300.454197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.454341:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1876568422022656:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635300.454365:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635300.454509:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410489984 00000100:00100000:0.0:1789635300.454518:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410489984 00010000:00010000:0.0:1789635300.454554:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 29 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635300.454588:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1789635300.454599:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+29:2349:x1876568410489984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635300.454612:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635300.454620:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 29 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.454633:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 29 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.454657:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb36cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d254 expref: 29 pid: 5842 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.454669:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e300) 00010000:00010000:0.0:1789635300.454673:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.454679:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.454684:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.454707:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635300.454745:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+28:2349:x1876568410489984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 150us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.454756:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00010000:00010000:3.0:1789635300.455731:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.455740:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789635300.455888:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789635300.456069:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1789635300.456168:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876568422022784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789635300.456209:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635300.456481:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45540 going to sleep for 11 seconds 00000100:00100000:2.0:1789635300.456755:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422022784 00000100:00100000:2.0:1789635300.456761:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422022784 00000100:00100000:2.0:1789635300.456824:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789635300.456848:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876568422022784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789635300.456929:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876568422022784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.456935:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635300.456987:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876568422022784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789635300.457357:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789635300.457397:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876568422022912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789635300.457420:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635300.457828:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635300.457910:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422022912 00000100:00100000:1.0:1789635300.457915:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422022912 00000100:00100000:1.0:1789635300.457937:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635300.457942:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1876568422022912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789635300.458097:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1876568422022912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 153us (673us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789635300.458103:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635300.458168:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876568422022912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789635300.458204:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789635300.458243:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.458250:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.458416:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.458422:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635300.458425:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.458431:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.458444:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e300) 00010000:00010000:3.0:1789635300.458447:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789635300.458449:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635300.458453:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb373d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635300.458575:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789635300.458665:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789635300.458674:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 276278361850ns, next at 277278360401ns, rc = 0 00000001:00080000:3.0:1789635300.458678:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789635300.458700:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e300) 00010000:00010000:3.0:1789635300.458702:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789635300.458706:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3728 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d27e expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635300.458785:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d32450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+31:11347:x1876568410489856:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 9225us (9350us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789635300.458797:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000020:00080000:3.0:1789635300.458801:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789635300.461027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.461123:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410490112 00000100:00100000:0.0:1789635300.461130:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410490112 00000100:00100000:0.0:1789635300.461193:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:0.0:1789635300.461201:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e717aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+31:11347:x1876568410490112:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635300.461233:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635300.461252:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d285 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.461303:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d285 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.461340:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d285 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.461354:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:0.0:1789635300.461356:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635300.461358:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030200, rc 0) 00000100:00100000:0.0:1789635300.461399:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e717aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+32:11347:x1876568410490112:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.461404:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:1.0:1789635300.464702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.464731:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.464754:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.464776:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.464797:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410490752 00000100:00100000:1.0:1789635300.464804:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410490752 00000100:00080000:1.0:1789635300.464827:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635300.464935:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410490368 00000100:00100000:2.0:1789635300.464938:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410490368 00000100:00100000:2.0:1789635300.464961:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789635300.464968:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+32:11347:x1876568410490368:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635300.465180:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+33:11347:x1876568410490368:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 211us (483us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789635300.465185:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1789635300.469234:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410490496 00000100:00100000:3.0:1789635300.469251:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410490496 00000100:00100000:3.0:1789635300.469355:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 278 00000100:00100000:3.0:1789635300.469365:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410490496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635300.469503:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410490624 00000100:00100000:0.0:1789635300.469509:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410490624 00000100:00100000:3.0:1789635300.484014:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2348:x1876568410490496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 14639us (19246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635300.484028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 278 00000100:00100000:0.0:1789635300.485554:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1789635300.485567:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410490624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635300.485639:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410490624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (20906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635300.485660:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1789635300.486457:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:1.0:1789635300.486472:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410490752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635300.486517:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2348:x1876568410490752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 50us (21738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635300.486525:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00080000:1.0:1789635300.486556:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635300.541718:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.541854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410491008 00000100:00100000:2.0:1789635300.541866:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410491008 00000100:00100000:2.0:1789635300.541975:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:2.0:1789635300.541987:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+33:11357:x1876568410491008:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635300.542013:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635300.542036:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb374b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d28c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635300.542140:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789635300.542875:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb374b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d28c expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.542892:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:2.0:1789635300.542895:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635300.542915:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb374b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d28c expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.542931:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820600, rc 0) 00000100:00100000:2.0:1789635300.543064:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+34:11357:x1876568410491008:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1079us (1356us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789635300.543071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:1.0:1789635300.545625:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.545703:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410491136 00000100:00100000:2.0:1789635300.545711:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410491136 00000100:00100000:2.0:1789635300.545779:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:2.0:1789635300.545786:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+34:11357:x1876568410491136:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1789635300.545847:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545860:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545872:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545887:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545894:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545900:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545975:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545992:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.545996:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635300.546034:0:7562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546045:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546060:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546067:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546074:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635300.546078:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546086:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546097:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635300.546099:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635300.546103:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546107:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3759 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546123:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546127:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546131:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546133:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635300.546135:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546138:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546142:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91f3a00) 00010000:00010000:2.0:1789635300.546144:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635300.546145:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546148:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546158:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546161:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546165:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546171:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635300.546173:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546177:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546181:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:2.0:1789635300.546182:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635300.546183:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.546186:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635300.546416:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+34:11357:x1876568410491136:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 628us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.546425:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:3.0:1789635300.548205:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635300.548347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410491392 00000100:00100000:0.0:1789635300.548357:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410491392 00000100:00100000:0.0:1789635300.548409:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:0.0:1789635300.548419:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+34:11357:x1876568410491392:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635300.548627:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+35:11357:x1876568410491392:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 209us (428us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789635300.548634:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1789635300.627430:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635300.627509:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635300.627530:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422023040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635300.627581:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635300.627660:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422023040 00000100:00100000:1.0:1789635300.627668:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422023040 00000100:00100000:1.0:1789635300.627722:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789635300.627731:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422023040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635300.627766:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635300.627808:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422023040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635300.627814:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789635300.627834:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635300.627876:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422023040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635300.633607:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410491648 00000100:00100000:0.0:1789635300.633625:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410491648 00000100:00100000:0.0:1789635300.633693:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:0.0:1789635300.633704:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+35:11360:x1876568410491648:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635300.633730:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635300.633754:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb376e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d293 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.633829:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.633846:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.633858:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.633873:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.633899:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.633905:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634026:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634035:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634042:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635300.634065:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789635300.634171:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634179:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634186:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634191:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635300.634195:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634202:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634224:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635300.634227:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635300.634232:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634238:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634251:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634257:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634263:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634267:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635300.634270:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634274:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634280:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d088e600) 00010000:00010000:0.0:1789635300.634283:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635300.634286:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634292:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb377c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634368:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb376e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634382:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635300.634389:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:0.0:1789635300.634392:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635300.634394:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635300.634462:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+37:11360:x1876568410491648:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 760us (7043us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789635300.634470:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:0.0:1789635300.642213:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.644190:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422023296:0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644252:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635300.644306:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789635300.644338:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422023168:0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635300.644398:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422023552:0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644420:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635300.644441:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635300.644447:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422023424:0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644481:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635300.644507:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422023168 00000100:00100000:2.0:1789635300.644514:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422023168 00000100:00100000:2.0:1789635300.644552:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789635300.644561:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422023168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644603:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422023168:12345-0@lo:400:kworker.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.644610:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789635300.644672:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422023168:0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644704:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410491776 00000100:00100000:2.0:1789635300.644710:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410491776 00000100:00100000:2.0:1789635300.644729:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422023296 00000100:00100000:2.0:1789635300.644731:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422023296 00000100:00100000:2.0:1789635300.644742:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422023552 00000100:00100000:2.0:1789635300.644744:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422023552 00000100:00100000:2.0:1789635300.644762:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422023424 00000100:00100000:2.0:1789635300.644764:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422023424 00000100:00100000:2.0:1789635300.644785:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789635300.644791:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422023296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644828:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422023296:12345-0@lo:400:kworker.0 Request processed in 37us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.644834:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789635300.644847:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789635300.644853:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422023552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644883:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422023552:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.644889:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789635300.644909:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789635300.644915:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422023424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.644942:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422023424:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.644948:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789635300.644962:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:2.0:1789635300.644968:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+37:11360:x1876568410491776:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789635300.645027:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645044:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645065:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645091:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645097:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645104:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645109:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635300.645113:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645120:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645137:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:2.0:1789635300.645140:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635300.645144:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635300.645150:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635300.645200:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+37:11360:x1876568410491776:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 231us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635300.645206:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:2.0:1789635300.645233:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422023424:0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.645241:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422023552:0@lo:400:kworker.0 00000100:00100000:2.0:1789635300.645261:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422023296:0@lo:400:kworker.0 00000100:00080000:1.0:1789635300.646242:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635300.652858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635300.653268:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410492032 00000100:00100000:2.0:1789635300.653282:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410492032 00000100:00100000:2.0:1789635300.654632:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:2.0:1789635300.654652:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+37:11360:x1876568410492032:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635300.654903:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+38:11360:x1876568410492032:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 258us (2053us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789635300.654922:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1789635301.089432:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635301.089611:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410492288 00000100:00100000:2.0:1789635301.089624:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410492288 00000100:00100000:2.0:1789635301.089677:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:2.0:1789635301.089687:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+38:11391:x1876568410492288:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789635301.089727:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635301.089748:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d29a expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.089859:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb379f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.089874:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb379f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.089887:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb379f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635301.089899:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789635301.090033:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d29a expref: 41 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.090065:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb379f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d29a expref: 40 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.090074:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:2.0:1789635301.090077:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635301.090080:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821000, rc 0) 00000100:00100000:2.0:1789635301.090155:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+40:11391:x1876568410492288:12345-192.168.201.30@tcp:101:cat.0 Request processed in 469us (735us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789635301.090162:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:0.0:1789635301.093871:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635301.093931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635301.094054:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410492416 00000100:00100000:1.0:1789635301.094064:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410492416 00000100:00100000:1.0:1789635301.094127:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1789635301.094138:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+40:2350:x1876568410492416:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635301.094153:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635301.094179:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb379f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d29a expref: 40 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.094198:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:1.0:1789635301.094203:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635301.094269:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+39:2350:x1876568410492416:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 133us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635301.094277:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:3.0:1789635301.094345:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410492672 00000100:00100000:3.0:1789635301.094350:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410492672 00000100:00100000:3.0:1789635301.094380:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1789635301.094388:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+39:11391:x1876568410492672:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:3.0:1789635301.094586:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+40:11391:x1876568410492672:12345-192.168.201.30@tcp:35:cat.0 Request processed in 198us (654us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789635301.094593:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:0.0:1789635301.164292:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635301.164454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410492928 00000100:00100000:1.0:1789635301.164465:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410492928 00000100:00100000:1.0:1789635301.164530:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:1.0:1789635301.164549:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+40:11397:x1876568410492928:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1789635301.164575:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635301.164578:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789635301.164604:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d270 expref: 40 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.164624:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:1.0:1789635301.164630:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635301.164644:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb37ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2a1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.164738:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.164752:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.164761:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.164793:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.164807:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 40 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635301.164821:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422023680:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635301.165032:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635301.169842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635301.169926:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410493056 00000100:00100000:3.0:1789635301.169937:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410493056 00010000:00010000:3.0:1789635301.169978:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 41 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635301.170009:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1789635301.170019:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+41:2351:x1876568410493056:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635301.170056:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635301.170064:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 41 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.170077:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 41 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.170099:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635301.170105:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.170114:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.170122:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.170141:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635301.170197:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+41:2351:x1876568410493056:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 179us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635301.170204:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00010000:00010000:1.0:1789635301.170882:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3783 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d293 expref: 40 pid: 5843 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635301.170899:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422023680:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635301.170919:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.170927:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.170934:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635301.170951:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789635301.171105:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb37ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.171120:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.171127:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:1.0:1789635301.171130:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789635301.171133:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635301.171162:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+40:11397:x1876568410492928:12345-192.168.201.30@tcp:101:dd.0 Request processed in 6616us (6883us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789635301.171169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:0.0:1789635301.173090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635301.173166:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410493312 00000100:00100000:2.0:1789635301.173174:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410493312 00000100:00100000:2.0:1789635301.173236:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 153 00000100:00100000:2.0:1789635301.173265:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+40:11397:x1876568410493312:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:2.0:1789635301.173537:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.173555:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.173566:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635301.173617:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789635301.173642:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca251101 reply state 000000007f7cc969 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635301.173651:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635301.173722:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+43:11397:x1876568410493312:12345-192.168.201.30@tcp:36:dd.0 Request processed in 467us (638us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789635301.173729:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 153 00000020:00080000:2.0:1789635301.173733:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789635301.179499:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.179517:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.179526:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.179549:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635301.179554:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.179562:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.179581:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635301.179584:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635301.179589:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.179595:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb37c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635301.396220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635301.400018:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410493440 00000100:00100000:3.0:1789635301.400044:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410493440 00000100:00100000:3.0:1789635301.400127:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 154 00000100:00100000:3.0:1789635301.400140:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+42:11411:x1876568410493440:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1789635301.400166:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635301.400187:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2a8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400378:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400394:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400407:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400450:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400458:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400467:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400553:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400564:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400572:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400607:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.400621:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 43 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635301.400635:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422023808:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635301.400830:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635301.414203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635301.415014:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410493696 00000100:00100000:2.0:1789635301.415027:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410493696 00000100:00100000:2.0:1789635301.415109:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:2.0:1789635301.415120:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+44:5580:x1876568410493696:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789635301.415508:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+45:5580:x1876568410493696:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 388us (1313us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789635301.415517:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789635301.420183:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422023808:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635301.420214:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635301.420410:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635301.420544:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410493824 00000100:00100000:2.0:1789635301.420552:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410493824 00010000:00010000:2.0:1789635301.420588:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 45 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635301.420686:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1789635301.420698:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+45:2349:x1876568410493824:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635301.420714:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635301.420723:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 45 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.420735:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 45 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.420758:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb37b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a1 expref: 45 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.420773:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:2.0:1789635301.420778:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.420787:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.420794:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.420829:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635301.420886:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+44:2349:x1876568410493824:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 190us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635301.420892:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00010000:00010000:3.0:1789635301.420942:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.420949:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635301.420992:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789635301.420996:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635301.421015:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421027:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421046:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421053:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421060:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421065:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635301.421069:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421076:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421085:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:3.0:1789635301.421093:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635301.421097:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421103:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb37d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421114:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421119:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421125:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421130:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635301.421132:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421138:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421145:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635301.421147:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635301.421149:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421154:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb37d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421203:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a8 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421227:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a8 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.421233:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635301.421235:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635301.421237:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73000, rc 0) 00000100:00100000:3.0:1789635301.421274:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+43:11411:x1876568410493440:12345-192.168.201.30@tcp:101:stat.0 Request processed in 21138us (25250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635301.421280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 154 00010000:00010000:3.0:1789635301.464008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635301.552470:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635301.556081:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410494080 00000100:00100000:2.0:1789635301.556115:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410494080 00000100:00100000:3.0:1789635301.560551:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 155 00000100:00100000:3.0:1789635301.560566:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+43:11417:x1876568410494080:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:3.0:1789635301.560649:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635301.560677:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb37de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2a8 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.560697:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635301.560702:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635301.560924:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.560938:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635301.560950:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789635301.561016:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789635301.561058:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000168d6725 reply state 000000009126b768 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635301.561067:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635301.561184:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+45:11417:x1876568410494080:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 620us (8723us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789635301.561191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 155 00000020:00080000:3.0:1789635301.561195:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789635301.567349:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.567384:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.567392:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.567399:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635301.567403:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.567411:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.567430:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:1.0:1789635301.567433:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635301.567437:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635301.567443:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb37e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635301.788368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635301.788519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410494208 00000100:00100000:2.0:1789635301.788792:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410494208 00000100:00100000:2.0:1789635301.788858:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:2.0:1789635301.788870:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+44:11431:x1876568410494208:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1789635301.788896:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635301.788920:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb37ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2af expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.788985:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.788999:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.789010:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.789024:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.789044:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.789051:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.789134:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.789143:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.789166:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635301.789982:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789635301.789988:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635301.790015:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790040:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790049:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790056:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790063:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790070:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635301.790074:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790082:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790095:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635301.790098:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635301.790102:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790121:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb37f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790137:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790143:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790149:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790154:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635301.790157:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790163:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.790171:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91f3a00) 00010000:00010000:2.0:1789635301.790173:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635301.790176:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.792140:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb37fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.792212:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb37ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.792228:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635301.792260:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:2.0:1789635301.792264:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635301.792267:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635301.792370:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+45:11431:x1876568410494208:12345-192.168.201.30@tcp:101:stat.0 Request processed in 3498us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635301.792378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:1.0:1789635301.980476:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635301.980721:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410494464 00000100:00100000:0.0:1789635301.980732:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410494464 00000100:00100000:0.0:1789635301.980830:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:0.0:1789635301.980840:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+45:11441:x1876568410494464:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635301.980874:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635301.980893:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2b6 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635301.980979:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789635301.981245:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3808 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2b6 expref: 47 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635301.981260:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:0.0:1789635301.981263:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635301.981267:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2b6 expref: 47 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635301.981280:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030e00, rc 0) 00000100:00100000:0.0:1789635301.981431:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+46:11441:x1876568410494464:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 592us (965us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1789635301.981438:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:0.0:1789635301.988263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635301.988619:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410494720 00000100:00100000:2.0:1789635301.988632:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410494720 00000100:00100000:2.0:1789635301.988864:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:2.0:1789635301.988876:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d31450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+46:11441:x1876568410494720:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635301.989205:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d31450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+47:11441:x1876568410494720:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 330us (952us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789635301.989212:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:1.0:1789635302.095100:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635302.095957:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410494976 00000100:00100000:3.0:1789635302.095970:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410494976 00000100:00080000:1.0:1789635302.096048:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635302.096061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:3.0:1789635302.096073:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+47:11447:x1876568410494976:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635302.096098:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635302.096118:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3816 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2bd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.096214:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.096229:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.097572:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.097624:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.097659:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 48 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635302.097676:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422023936:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635302.097977:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c674f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635302.108301:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.108808:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410495104 00000100:00100000:0.0:1789635302.108818:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410495104 00010000:00010000:0.0:1789635302.108917:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 49 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635302.108960:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1789635302.108972:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79d00c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+49:2349:x1876568410495104:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635302.108988:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635302.108997:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 49 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.109036:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 49 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.109060:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:0.0:1789635302.109066:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.109076:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.109084:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.109106:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635302.109161:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79d00c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+49:2349:x1876568410495104:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 191us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635302.109168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00010000:00010000:3.0:1789635302.110686:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2af expref: 48 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635302.110709:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422023936:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635302.110729:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.110739:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.110745:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635302.111621:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789635302.111949:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3816 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.111968:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.111977:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635302.111990:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635302.111994:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72000, rc 0) 00000100:00100000:3.0:1789635302.112068:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+48:11447:x1876568410494976:12345-192.168.201.30@tcp:101:bash.0 Request processed in 15997us (17058us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789635302.112077:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:1.0:1789635302.116614:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635302.116827:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410495360 00000100:00100000:3.0:1789635302.116845:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410495360 00000100:00100000:3.0:1789635302.116905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 159 00000100:00100000:3.0:1789635302.116916:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+48:11447:x1876568410495360:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:0.0:1789635302.117952:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.117972:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.117984:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635302.118124:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789635302.118153:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c27088a reply state 0000000076432115 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635302.118246:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635302.118422:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+51:11447:x1876568410495360:12345-192.168.201.30@tcp:36:bash.0 Request processed in 1505us (1815us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789635302.118430:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 159 00000020:00080000:0.0:1789635302.118435:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789635302.120414:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.120427:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.120435:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.120442:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635302.120447:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.120453:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.120469:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635302.120472:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635302.120477:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.120483:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb382b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635302.129443:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635302.129775:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410495488 00000100:00100000:2.0:1789635302.129787:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410495488 00000100:00100000:2.0:1789635302.129894:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 160 00000100:00100000:2.0:1789635302.129906:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+50:11447:x1876568410495488:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789635302.129932:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635302.129953:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb3832 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.130187:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.130203:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.130224:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.130262:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.130277:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 51 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635302.130299:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422024064:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635302.130415:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31240 going to sleep for 11 seconds 00000100:00100000:2.0:1789635302.134403:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422024064:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635302.134432:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635302.134906:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635302.135092:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410495616 00000100:00100000:1.0:1789635302.135100:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410495616 00010000:00010000:1.0:1789635302.135148:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 52 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635302.135199:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:1.0:1789635302.135209:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:2348:x1876568410495616:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635302.135224:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635302.135231:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 52 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635302.135243:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 52 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635302.135264:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb381d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2bd expref: 52 pid: 5842 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635302.135280:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:1.0:1789635302.135295:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635302.135304:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635302.135346:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635302.135375:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635302.135426:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+51:2348:x1876568410495616:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 218us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635302.135434:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:0.0:1789635302.135804:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.135813:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635302.135863:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789635302.135868:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635302.135885:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.135915:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb3832 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2c4 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.135929:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2c4 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.135936:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:0.0:1789635302.135939:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635302.135941:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820200, rc 0) 00000100:00100000:0.0:1789635302.135966:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+50:11447:x1876568410495488:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6063us (6532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635302.135982:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 160 00000100:00100000:1.0:1789635302.150802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.150911:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410495872 00000100:00100000:0.0:1789635302.150920:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410495872 00000100:00100000:0.0:1789635302.151102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1789635302.151114:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+50:11447:x1876568410495872:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:0.0:1789635302.151387:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+51:11447:x1876568410495872:12345-192.168.201.30@tcp:35:bash.0 Request processed in 276us (593us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789635302.151394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1789635302.375087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.375213:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410496128 00000100:00100000:0.0:1789635302.375225:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410496128 00000100:00100000:0.0:1789635302.375295:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:0.0:1789635302.375308:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+51:11457:x1876568410496128:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635302.375367:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635302.375388:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2cb expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635302.375485:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789635302.375926:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3840 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2cb expref: 53 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.375943:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:0.0:1789635302.375946:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635302.375952:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2cb expref: 53 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.375967:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030a00, rc 0) 00000100:00100000:0.0:1789635302.376087:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+52:11457:x1876568410496128:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 781us (1012us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789635302.376095:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:1.0:1789635302.380576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635302.380817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410496256 00000100:00100000:3.0:1789635302.380890:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410496256 00000100:00100000:3.0:1789635302.380951:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:3.0:1789635302.380962:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:11457:x1876568410496256:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1789635302.381048:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381065:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381080:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381094:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381102:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381109:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381400:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381410:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381418:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635302.381478:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381491:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381497:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381504:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381510:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635302.381515:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381594:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381608:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:3.0:1789635302.381611:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635302.381616:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381622:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb384e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381635:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381641:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381723:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381729:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635302.381732:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381739:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381747:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635302.381749:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635302.381752:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381758:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381772:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381778:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381783:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381788:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635302.381791:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381808:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381816:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635302.381818:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635302.381821:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.381903:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb385c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635302.382043:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:11457:x1876568410496256:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 1081us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.382052:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:1.0:1789635302.402258:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635302.402497:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410496512 00000100:00100000:2.0:1789635302.402509:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410496512 00000100:00100000:2.0:1789635302.402581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:2.0:1789635302.402592:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:11457:x1876568410496512:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635302.402998:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+53:11457:x1876568410496512:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 406us (748us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789635302.403007:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1789635302.467428:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635302.468857:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410496768 00000100:00100000:2.0:1789635302.468872:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410496768 00000100:00100000:2.0:1789635302.468943:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:2.0:1789635302.468954:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+53:11460:x1876568410496768:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635302.468997:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635302.469029:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3863 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469112:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469128:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469138:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469154:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469712:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469722:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469844:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3878 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469853:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469861:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635302.469871:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789635302.469968:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469977:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469983:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.469989:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635302.469993:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470001:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470012:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635302.470042:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635302.470046:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470052:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb386a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470067:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470073:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470079:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470083:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635302.470091:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470098:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470105:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91f3a00) 00010000:00010000:2.0:1789635302.470107:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635302.470109:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.470115:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.471913:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3863 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2d2 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.471951:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3878 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2d2 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.471960:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:2.0:1789635302.471963:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635302.471966:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821e00, rc 0) 00000100:00100000:2.0:1789635302.472056:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+55:11460:x1876568410496768:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3103us (4638us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789635302.472065:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 163 00010000:00010000:3.0:1789635302.486003:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635302.491076:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635302.491120:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.491211:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410496896 00000100:00100000:0.0:1789635302.491222:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410496896 00000100:00100000:0.0:1789635302.491296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:0.0:1789635302.491308:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+55:11460:x1876568410496896:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1789635302.491420:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491437:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491448:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491474:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491481:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491488:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491494:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635302.491499:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491506:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491547:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:0.0:1789635302.491550:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635302.491555:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.491562:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635302.491628:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+55:11460:x1876568410496896:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 322us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635302.491636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:2.0:1789635302.491905:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410497024 00000100:00100000:2.0:1789635302.491910:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410497024 00000100:00100000:2.0:1789635302.491948:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1789635302.491956:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+55:2348:x1876568410497024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635302.491973:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635302.491988:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3878 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2d2 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635302.491998:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:2.0:1789635302.492002:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635302.492034:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+54:2348:x1876568410497024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 78us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635302.492040:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1789635302.498714:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.498792:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410497280 00000100:00100000:0.0:1789635302.498801:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410497280 00000100:00100000:0.0:1789635302.498862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:0.0:1789635302.498871:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+54:11460:x1876568410497280:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635302.499111:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+55:11460:x1876568410497280:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 240us (405us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789635302.499119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1789635302.770438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.770554:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410497536 00000100:00100000:0.0:1789635302.770565:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410497536 00000100:00100000:0.0:1789635302.770625:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:0.0:1789635302.770636:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+55:11478:x1876568410497536:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:0.0:1789635302.770669:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635302.770690:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb388d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2d9 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.770785:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3894 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.770813:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3894 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.770836:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3894 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635302.770848:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789635302.770979:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb388d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2d9 expref: 58 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.770998:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2d9 expref: 57 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.771007:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:0.0:1789635302.771024:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789635302.771027:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635302.771092:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+57:11478:x1876568410497536:12345-192.168.201.30@tcp:101:cat.0 Request processed in 457us (665us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789635302.771099:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:1.0:1789635302.841892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.842076:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410497664 00000100:00100000:0.0:1789635302.842087:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410497664 00000100:00100000:0.0:1789635302.842149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:0.0:1789635302.842159:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+57:11479:x1876568410497664:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635302.842186:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635302.842207:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2e0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.842303:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb38a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.842344:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb38a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.842356:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb38a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635302.842389:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789635302.842393:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635302.842409:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb38a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.842432:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e0 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.842449:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb38a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e0 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.842458:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635302.842461:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635302.842465:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031000, rc 0) 00000100:00100000:0.0:1789635302.842767:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+58:11479:x1876568410497664:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 608us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635302.842774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:1.0:1789635302.849339:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.849420:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410498048 00000100:00100000:0.0:1789635302.849431:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410498048 00000100:00100000:0.0:1789635302.849504:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1789635302.849522:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+58:11479:x1876568410498048:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635302.849863:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+59:11479:x1876568410498048:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 341us (562us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789635302.849870:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:1.0:1789635302.853438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635302.853538:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410498176 00000100:00100000:3.0:1789635302.853548:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410498176 00000100:00100000:3.0:1789635302.853615:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1789635302.853626:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+59:11479:x1876568410498176:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:3.0:1789635302.853642:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789635302.853849:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3839 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2c4 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.853870:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2d9 expref: 58 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.853881:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d285 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.853907:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e700) 00010000:00010000:3.0:1789635302.853918:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635302.853971:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+56:11479:x1876568410498176:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 347us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.853978:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1789635302.857740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635302.857856:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410498304 00000100:00100000:0.0:1789635302.857866:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410498304 00000100:00100000:0.0:1789635302.857922:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:0.0:1789635302.857930:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+56:11479:x1876568410498304:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:0.0:1789635302.858053:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.858067:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635302.858078:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789635302.858274:0:7562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789635302.858764:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+56:11479:x1876568410498304:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 832us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635302.858774:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:1.0:1789635302.885004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635302.885192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410498432 00000100:00100000:3.0:1789635302.885205:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410498432 00000100:00100000:3.0:1789635302.885279:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 168 00000100:00100000:3.0:1789635302.885290:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+56:11481:x1876568410498432:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635302.885343:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635302.885364:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885426:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885440:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885449:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885461:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885468:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885490:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885582:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885591:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885599:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635302.885632:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789635302.885636:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635302.885902:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885915:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885922:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885929:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885936:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885943:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635302.885946:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885960:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885971:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:3.0:1789635302.885974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635302.885978:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885984:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.885996:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886003:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886020:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886025:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635302.886027:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886033:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886041:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91bae00) 00010000:00010000:3.0:1789635302.886043:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635302.886046:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886060:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886092:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886104:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635302.886111:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:3.0:1789635302.886113:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635302.886115:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73600, rc 0) 00000100:00100000:3.0:1789635302.886179:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+57:11481:x1876568410498432:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 891us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635302.886186:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 168 00000040:00080000:2.0:1789635303.317268:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635303.317278:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635303.317335:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789635303.317343:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635303.317467:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422024192:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635303.317557:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31180 going to sleep for 11 seconds 00000100:00100000:3.0:1789635303.328381:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422024192:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635303.331304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.331636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410498560 00000100:00100000:3.0:1789635303.331647:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410498560 00000100:00100000:3.0:1789635303.331713:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:3.0:1789635303.331723:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+57:11492:x1876568410498560:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789635303.331757:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789635303.331864:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+57:11492:x1876568410498560:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 141us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.331871:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:3.0:1789635303.363090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.363129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410498688 00000100:00100000:3.0:1789635303.363139:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410498688 00000100:00100000:3.0:1789635303.363185:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:3.0:1789635303.363196:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+57:11492:x1876568410498688:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789635303.363275:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.363291:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.363304:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364623:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364642:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364651:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364681:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364689:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364695:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635303.364735:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789635303.364749:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635303.364763:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364776:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364783:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364790:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364795:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635303.364800:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364807:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364820:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:3.0:1789635303.364823:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635303.364827:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364833:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb38d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364848:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364854:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364868:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364874:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635303.364877:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364883:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364890:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9e79d91bac00) 00010000:00010000:3.0:1789635303.364892:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635303.364894:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364899:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb38da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364913:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364920:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364925:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364929:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635303.364932:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364947:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364954:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:3.0:1789635303.364956:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635303.364959:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.364965:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb38e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.365077:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+57:11492:x1876568410498688:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1866us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.365087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:0.0:1789635303.374441:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.376674:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410498944 00000100:00100000:3.0:1789635303.376690:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410498944 00000100:00100000:3.0:1789635303.376753:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:3.0:1789635303.376763:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+57:11492:x1876568410498944:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635303.376782:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635303.376801:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb38e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377452:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377467:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377479:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635303.377497:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789635303.377706:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377714:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377721:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377728:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635303.377732:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377738:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377751:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:3.0:1789635303.377754:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635303.377758:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377765:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb38ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.377804:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb38e8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2ee expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.380080:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:3.0:1789635303.380084:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635303.380099:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb38e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2ee expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.380113:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72200, rc 0) 00000100:00100000:3.0:1789635303.380185:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+58:11492:x1876568410498944:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3423us (5755us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1789635303.380194:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:0.0:1789635303.384012:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.384163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410499072 00000100:00100000:3.0:1789635303.384173:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410499072 00000100:00100000:3.0:1789635303.384238:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:3.0:1789635303.384248:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+58:11492:x1876568410499072:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789635303.384283:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789635303.384412:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+58:11492:x1876568410499072:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 165us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.384420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:1.0:1789635303.392289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635303.392520:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410499328 00000100:00100000:0.0:1789635303.392530:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410499328 00000100:00100000:0.0:1789635303.392580:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:0.0:1789635303.392590:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+58:11492:x1876568410499328:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635303.392621:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635303.392625:0:7562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635303.392650:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb38a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e0 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.392669:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635303.392674:0:7562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635303.392686:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb38fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2f5 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635303.393072:0:7562:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789635303.393247:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3904 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.393261:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.393271:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.394471:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb38fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2f5 expref: 60 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.394592:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2f5 expref: 59 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.394605:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d088e000) 00010000:00010000:0.0:1789635303.394608:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635303.394618:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030400, rc 0) 00000100:00100000:0.0:1789635303.394688:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+59:11492:x1876568410499328:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2098us (2407us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789635303.394697:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:1.0:1789635303.411055:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.412927:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410499584 00000100:00100000:2.0:1789635303.412942:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410499584 00000100:00100000:2.0:1789635303.413018:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00100000:2.0:1789635303.413030:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+59:11492:x1876568410499584:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789635303.413090:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635303.413117:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2f5 expref: 59 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413137:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d088e000) 00010000:00010000:2.0:1789635303.413148:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635303.413171:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413198:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413209:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413459:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413468:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413476:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413921:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413930:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413937:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413943:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635303.413947:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413955:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413964:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635303.413973:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635303.413977:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.413983:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb3912 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.414005:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.414012:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.414018:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.414023:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635303.414026:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.414032:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.414040:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x174607ff (ffff9e79d91f3700) 00010000:00010000:2.0:1789635303.414043:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635303.414046:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.414051:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3919 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x174607ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635303.414184:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+58:11492:x1876568410499584:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1155us (3139us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789635303.414201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00100000:1.0:1789635303.423123:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.423195:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410499712 00000100:00100000:2.0:1789635303.423207:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410499712 00000100:00100000:2.0:1789635303.423272:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:2.0:1789635303.423282:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+58:11492:x1876568410499712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635303.423304:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635303.423390:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb3920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d2fc expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.423430:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.423443:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.423454:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.423570:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820600/0x77332204cfbb3920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 60 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.423587:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 59 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.423595:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:2.0:1789635303.423598:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789635303.423602:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635303.423663:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+59:11492:x1876568410499712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 382us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635303.423678:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:1.0:1789635303.427543:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.428184:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410499968 00000100:00100000:3.0:1789635303.428196:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410499968 00000100:00100000:3.0:1789635303.428275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 176 00000100:00100000:3.0:1789635303.428287:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+59:11492:x1876568410499968:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789635303.428888:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.428907:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.428919:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635303.430644:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789635303.430663:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 279250350804ns, next at 280250347174ns, rc = 0 00000004:00010000:3.0:1789635303.430773:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000483b78c4 reply state 00000000e433cc18 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.430785:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635303.430979:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+61:11492:x1876568410499968:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 2691us (3441us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789635303.430988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 176 00010000:00010000:2.0:1789635303.437131:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.437149:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.437157:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.437163:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635303.437168:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.437175:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.437191:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:2.0:1789635303.437194:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789635303.437198:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.437204:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb392e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635303.444873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.451469:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410500096 00000100:00100000:2.0:1789635303.451485:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410500096 00000100:00100000:3.0:1789635303.452587:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00100000:3.0:1789635303.452600:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+60:11492:x1876568410500096:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635303.452628:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635303.452650:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d303 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.452712:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 61 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.452726:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 61 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.452746:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:3.0:1789635303.452750:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635303.452754:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73200, rc 0) 00000100:00100000:3.0:1789635303.452839:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+61:11492:x1876568410500096:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 241us (7975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.452860:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00100000:0.0:1789635303.461253:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.461365:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410500224 00000100:00100000:2.0:1789635303.461376:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410500224 00000100:00100000:2.0:1789635303.461443:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1789635303.461454:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410500224:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789635303.461839:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410500224:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 386us (595us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789635303.461847:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00080000:3.0:1789635303.462360:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635303.473021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635303.473098:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410500480 00000100:00100000:0.0:1789635303.473110:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410500480 00000100:00100000:0.0:1789635303.473168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1789635303.473179:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+61:11492:x1876568410500480:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789635303.473644:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+62:11492:x1876568410500480:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 465us (645us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789635303.473652:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:2.0:1789635303.489258:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.489372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410500736 00000100:00100000:3.0:1789635303.489383:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410500736 00000100:00100000:3.0:1789635303.489430:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:3.0:1789635303.489440:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+62:11492:x1876568410500736:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789635303.489543:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+62:11492:x1876568410500736:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.489551:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:1.0:1789635303.491900:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.491978:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410500864 00000100:00100000:3.0:1789635303.491987:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410500864 00000100:00100000:3.0:1789635303.492119:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:3.0:1789635303.492129:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+62:11492:x1876568410500864:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635303.492148:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635303.492167:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb393c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d30a expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.492255:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.492271:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.492283:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635303.492353:0:7562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635303.492381:0:7562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.492408:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb393c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d30a expref: 64 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.492427:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d30a expref: 63 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.492436:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:3.0:1789635303.492440:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789635303.492443:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73000, rc 0) 00000100:00100000:3.0:1789635303.492492:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+63:11492:x1876568410500864:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 364us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.492500:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:1.0:1789635303.498129:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635303.498294:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410500992 00000100:00100000:0.0:1789635303.498305:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410500992 00000100:00100000:0.0:1789635303.498384:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789635303.498394:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410500992:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635303.498414:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635303.498435:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d311 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635303.498461:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabaae8, blocks: 0x1 00010000:00010000:0.0:1789635303.498481:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=279s v=(0 0) 00010000:00010000:0.0:1789635303.498486:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635303.498494:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.498528:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.498541:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030e00, rc 0) 00000100:00100000:0.0:1789635303.498595:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410500992:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 202us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635303.498602:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:1.0:1789635303.501257:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.501396:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410501248 00000100:00100000:3.0:1789635303.501405:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410501248 00000100:00100000:3.0:1789635303.501445:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:3.0:1789635303.501454:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+63:11492:x1876568410501248:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789635303.501549:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+63:11492:x1876568410501248:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.501558:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:1.0:1789635303.504397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.504468:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410501376 00000100:00100000:2.0:1789635303.504478:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410501376 00000100:00100000:2.0:1789635303.504525:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1789635303.504535:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:11492:x1876568410501376:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635303.504551:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635303.504569:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d318 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.504599:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.504609:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635303.504613:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635303.504619:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.504652:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.504666:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 9 pid: 6693 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635303.504697:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422024320:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635303.504781:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635303.507857:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876568422024320:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635303.507892:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.507914:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821000, rc 0) 00000100:00100000:2.0:1789635303.507972:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:11492:x1876568410501376:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3439us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635303.507982:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00010000:00010000:2.0:1789635303.508511:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635303.509832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.509902:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410501504 00000100:00100000:2.0:1789635303.509910:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410501504 00010000:00010000:2.0:1789635303.509945:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 9 pid: 6693 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635303.509985:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1789635303.509994:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+9:2348:x1876568410501504:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635303.510028:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635303.510048:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 9 pid: 6693 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.510064:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 9 pid: 6693 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.510101:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000635f3801/0x77332204cfbb394a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d311 expref: 9 pid: 6693 timeout: 379 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.510116:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635303.510120:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635303.510128:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.510139:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.510175:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635303.510190:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1876568422024448:192.168.201.30@tcp:105: 00000100:00100000:2.0:1789635303.510345:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635303.513902:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1876568422024448:192.168.201.30@tcp:105: 00010000:00010000:2.0:1789635303.513928:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635303.513983:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410501504:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3989us (4153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635303.514061:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:1.0:1789635303.516704:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.516780:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410501632 00000100:00100000:2.0:1789635303.516790:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410501632 00002000:00100000:2.0:1789635303.516847:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e79e7ed9f80 x1876568410501632/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:679/0 lens 504/0 e 0 to 0 dl 1789635314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635303.516865:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7ed9f80 with x1876568410501632 ext(0->8) 00002000:00010000:2.0:1789635303.516870:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7ed9f80 00000100:00100000:2.0:1789635303.516906:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789635303.516915:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410501632:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789635303.517663:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+10:2348:x1876568410501632:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 746us (964us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789635303.517673:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00002000:00100000:2.0:1789635303.517681:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e79e7ed9f80 x1876568410501632/t4294967314(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:679/0 lens 504/448 e 0 to 0 dl 1789635314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635303.517689:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79e7ed9f80 with x1876568410501632 ext(0->8) 00002000:00010000:2.0:1789635303.517694:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79e7ed9f80 00000100:00100000:1.0:1789635303.519719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.520070:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410501760 00000100:00100000:3.0:1789635303.520079:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410501760 00000100:00100000:3.0:1789635303.520127:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:3.0:1789635303.520136:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+63:11492:x1876568410501760:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789635303.616881:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+63:11492:x1876568410501760:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 96737us (97159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635303.616900:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 181 00000001:00080000:1.0:1789635303.616934:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1789635303.617075:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1789635303.617108:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789635303.617124:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79c70f86c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789635303.617129:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79c83ca000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79c70f8b40 00000020:00080000:1.0:1789635303.617132:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79c83ca800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79fdf7fc00 00000020:00080000:1.0:1789635303.617429:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789635303.617595:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789635303.617610:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422024576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789635303.617657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635303.617701:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635303.617706:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422024704:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789635303.617724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635303.617751:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422024576 00000100:00100000:1.0:1789635303.617758:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422024576 00000100:00100000:1.0:1789635303.617794:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422024704 00000100:00100000:1.0:1789635303.617797:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422024704 00000100:00100000:1.0:1789635303.617816:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789635303.617824:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422024576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789635303.617937:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789635303.617941:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789635304 00002000:00010000:1.0:1789635303.617943:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789635303.617946:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789635304 -> 1789635304 00002000:00010000:1.0:1789635303.617948:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789635303.617980:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422024576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (323us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789635303.618476:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789635303.618495:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789635303.618503:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422024704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789635303.618519:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789635303.618545:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aabaae5, atime: 0x6aabaae5, ctime: 0x6aabaae5, blocks: 0x1 00010000:00010000:1.0:1789635303.618552:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.618567:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=279s v=(0 0) 00010000:00010000:1.0:1789635303.618572:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635303.618579:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.618594:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.618604:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.618612:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.618631:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789635303.619939:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876568422024704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 490us (1265us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789635303.619954:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789635303.620189:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635303.620194:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789635303.620975:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79e7edaa00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789635303.620983:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422024704:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789635303.621784:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79e7edbb80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789635303.621790:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422024576:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789635303.621818:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635303.621826:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.621838:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635303.621842:0:7641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.621853:0:7641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.621872:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.621879:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070648d44/0x77332204cfbb3958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.621899:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635303.621901:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635303.621902:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635303.623786:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.624861:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410501888 00000100:00100000:3.0:1789635303.624881:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410501888 00000100:00100000:3.0:1789635303.624958:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1789635303.624967:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+10:2349:x1876568410501888:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789635303.709734:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+10:2349:x1876568410501888:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 84756us (85942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635303.709748:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000001:00080000:1.0:1789635303.709786:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1789635303.709809:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1789635303.716020:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635303.716062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410502144 00000100:00100000:1.0:1789635303.716071:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410502144 00000100:00100000:1.0:1789635303.716136:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:1.0:1789635303.716146:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:11492:x1876568410502144:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789635303.716196:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635303.716668:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d30a expref: 18 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.716687:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:1.0:1789635303.716692:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635303.716721:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.716732:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.716741:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635303.716972:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bd16c2d reply state 0000000041ea2069 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635303.716983:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635303.717163:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+19:11492:x1876568410502144:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1017us (1150us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789635303.717171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:2.0:1789635303.732962:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1789635303.733042:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.733055:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.733063:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.733070:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635303.733075:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.733083:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.733109:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:3.0:1789635303.733113:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635303.733118:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.733124:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb395f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635303.733864:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410502272 00000100:00100000:1.0:1789635303.733876:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410502272 00000100:00100000:1.0:1789635303.733930:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:1.0:1789635303.733941:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410502272:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789635303.734304:0:8106:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789635303.734308:0:8106:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789635304 -> 1789635303 00002000:00010000:1.0:1789635303.734682:0:8106:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789635301 00002000:00010000:1.0:1789635303.734684:0:8106:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789635304 -> 1789635303 00002000:00010000:1.0:1789635303.734687:0:8106:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789635303.734753:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410502272:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 813us (1800us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789635303.734761:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1789635303.737962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.738039:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410502528 00000100:00100000:3.0:1789635303.738048:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410502528 00000100:00100000:3.0:1789635303.738163:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:3.0:1789635303.738173:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+18:11492:x1876568410502528:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789635303.738258:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.738275:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 18 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.738284:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.738638:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 18 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.738653:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 18 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.738667:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7242d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422024832:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635303.738749:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c706e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635303.749751:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7242d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422024832:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635303.749780:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635303.756666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635303.756719:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410502656 00000100:00100000:0.0:1789635303.756731:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410502656 00010000:00010000:0.0:1789635303.756770:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635303.756812:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:0.0:1789635303.756822:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:2349:x1876568410502656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635303.756836:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635303.756843:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.756857:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.757210:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2fc expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.757236:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:0.0:1789635303.757242:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.757251:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.757259:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.757284:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635303.757359:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+18:2349:x1876568410502656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 537us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635303.757367:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00010000:00010000:0.0:1789635303.758509:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758519:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758541:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758546:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758551:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758554:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635303.758566:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758572:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758580:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:0.0:1789635303.758582:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789635303.758585:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635303.758589:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3966 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635303.758634:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+17:11492:x1876568410502528:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 20462us (20680us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789635303.758640:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:0.0:1789635303.763597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000040:00080000:3.0:1789635303.764506:0:12519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635303.764512:0:12519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635303.764557:0:12519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789635303.764562:0:12519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789635303.765001:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410502784 00000100:00100000:1.0:1789635303.765011:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410502784 00000100:00100000:1.0:1789635303.766113:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789635303.766127:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410502784:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789635303.766171:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.766191:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.766201:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635303.766222:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635303.766228:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.766266:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.766281:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 8 pid: 6691 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635303.766296:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7edb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1876568422024960:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635303.766592:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635303.771108:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.771366:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410502912 00000100:00100000:3.0:1789635303.771375:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410502912 00010000:00010000:3.0:1789635303.771409:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 9 pid: 6691 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.771454:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1789635303.771464:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410502912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635303.771479:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635303.771502:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 9 pid: 6691 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.771516:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 9 pid: 6691 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.771542:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635303.771547:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635303.771553:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.771564:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.771584:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635303.771633:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410502912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 170us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.771640:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00010000:00010000:2.0:1789635303.772568:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3951 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d318 expref: 8 pid: 6691 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635303.772584:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7edb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1876568422024960:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635303.772604:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772615:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772634:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772660:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772668:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772675:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772682:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635303.772686:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772695:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772708:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.772715:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff42e24/0x77332204cfbb396d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635303.772875:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410502784:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 6750us (9287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635303.772884:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1789635303.779146:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.779569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410503168 00000100:00100000:2.0:1789635303.779583:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410503168 00000100:00100000:2.0:1789635303.779638:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:2.0:1789635303.779649:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+17:11492:x1876568410503168:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789635303.779727:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.779744:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.779755:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.780122:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.780134:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 18 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.780143:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.780177:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 18 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635303.780218:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 18 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635303.780234:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422025088:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635303.780333:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbcce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635303.792809:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635303.793126:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422025088:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635303.793152:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.793407:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410503296 00000100:00100000:3.0:1789635303.793416:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410503296 00010000:00010000:3.0:1789635303.793455:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.793509:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1789635303.793521:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79d00c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:2348:x1876568410503296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635303.793536:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635303.793544:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.793557:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.793579:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3935 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d303 expref: 19 pid: 7562 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.793593:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:3.0:1789635303.793598:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.793607:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.793615:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.793636:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635303.793687:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79d00c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+18:2348:x1876568410503296:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 168us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.793695:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00010000:00010000:1.0:1789635303.793794:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.793813:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635303.794040:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1789635303.794230:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1789635303.794280:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1789635303.794410:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876568422025216:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789635303.794457:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635303.794507:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635303.794643:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422025216 00000100:00100000:3.0:1789635303.794655:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422025216 00000100:00100000:3.0:1789635303.794696:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789635303.794703:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876568422025216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789635303.794771:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876568422025216:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635303.794777:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635303.795107:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1789635303.795120:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79e7edbb80, transno 4294967315 00000100:00100000:1.0:1789635303.795137:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876568422025216:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789635303.795593:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1789635303.795652:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876568422025344:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789635303.795684:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635303.795703:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635303.795718:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422025344 00000100:00100000:1.0:1789635303.795722:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422025344 00000100:00100000:1.0:1789635303.795749:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635303.795756:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876568422025344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789635303.795906:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1876568422025344:12345-0@lo:1000:mdt00_002.0 Request processed in 149us (220us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789635303.795913:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635303.795946:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876568422025344:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789635303.796760:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.796772:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.796780:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.796786:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635303.796790:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797095:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797110:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91f3500) 00010000:00010000:1.0:1789635303.797121:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635303.797126:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797132:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb397b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797162:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797168:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797174:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797179:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635303.797181:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797187:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797194:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:1.0:1789635303.797196:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635303.797199:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797388:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb38b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797411:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797424:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797433:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797464:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.797481:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 21 pid: 5842 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635303.797494:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422025472:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635303.797557:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1789635303.815777:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635303.815934:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422025472:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635303.816047:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.816290:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410503424 00000100:00100000:3.0:1789635303.816298:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410503424 00010000:00010000:3.0:1789635303.816372:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 22 pid: 5842 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635303.825418:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1789635303.825441:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+22:2348:x1876568410503424:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635303.825462:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635303.825474:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 22 pid: 5842 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.825491:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 22 pid: 5842 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.825525:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb38cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d2e7 expref: 22 pid: 5842 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.825538:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:1.0:1789635303.825543:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.825552:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.825559:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.825595:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635303.825652:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:2348:x1876568410503424:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 220us (9885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635303.825660:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00010000:00010000:3.0:1789635303.827271:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827288:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827301:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827308:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827340:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827346:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635303.827359:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827366:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827393:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:3.0:1789635303.827396:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635303.827401:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827407:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3982 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827421:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827427:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827432:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827438:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635303.827440:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827445:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827452:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:3.0:1789635303.827455:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635303.827458:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.827463:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3974 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.827715:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+20:11492:x1876568410503168:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 48066us (48576us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789635303.827724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 184 00000020:00080000:3.0:1789635303.827729:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789635303.827813:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635303.827818:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635303.828639:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789635303.828649:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635303.842633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635303.845071:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410503680 00000100:00100000:3.0:1789635303.845086:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410503680 00000100:00100000:3.0:1789635303.845161:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:3.0:1789635303.845171:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:11492:x1876568410503680:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789635303.845851:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789635303.845957:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789635303.846013:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.846029:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.846040:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.846050:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.846057:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.846065:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635303.846097:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635303.846177:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635303.846185:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.846192:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635303.846196:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635303.846202:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:11492:x1876568410503680:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1032us (3577us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789635303.846209:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000020:00080000:3.0:1789635303.846214:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789635303.846231:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.846243:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e79d91bac00) 00010000:00010000:1.0:1789635303.846246:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789635303.846250:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.846255:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3989 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635303.846272:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635303.846274:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635303.846276:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635304.214696:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789635304.214722:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422025600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635304.214802:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635304.214915:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422025600 00000100:00100000:2.0:1789635304.214923:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422025600 00000100:00100000:2.0:1789635304.214964:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789635304.214973:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568422025600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635304.215019:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635304.215082:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568422025600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635304.215089:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789635304.215350:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422025600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789635304.533278:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635305.575563:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635305.588306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635305.588386:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635305.588418:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635305.588438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635305.588457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635305.588482:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410504320 00000100:00100000:0.0:1789635305.588491:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410504320 00000100:00100000:0.0:1789635305.588545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410503936 00000100:00100000:0.0:1789635305.588559:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410503936 00000100:00100000:0.0:1789635305.588583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1789635305.588592:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410504320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635305.588677:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410504320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635305.588684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1789635305.588701:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:0.0:1789635305.588707:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+22:2349:x1876568410503936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635305.588737:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+22:2349:x1876568410503936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635305.588743:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:1.0:1789635305.589031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410503808 00000100:00100000:1.0:1789635305.589036:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410503808 00000100:00100000:1.0:1789635305.589083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:1.0:1789635305.589090:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410503808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635305.589121:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410503808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.589127:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:1.0:1789635305.589153:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410504064 00000100:00100000:1.0:1789635305.589156:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410504064 00000100:00100000:1.0:1789635305.589179:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410504192 00000100:00100000:1.0:1789635305.589181:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410504192 00000100:00100000:1.0:1789635305.589198:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1789635305.589205:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410504064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635305.589245:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410504064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.589251:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1789635305.589262:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1789635305.589268:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410504192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635305.589291:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410504192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.589297:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00080000:1.0:1789635305.589338:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635305.589342:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635305.589345:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635305.747499:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635305.747520:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422025728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635305.747582:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635305.747844:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422025728 00000100:00100000:1.0:1789635305.747852:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422025728 00000100:00100000:1.0:1789635305.747931:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789635305.747941:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876568422025728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635305.747985:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635305.748030:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876568422025728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.748037:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789635305.748085:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422025728:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789635305.748271:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635305.751659:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422025984:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.751725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635305.751775:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789635305.751781:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422025856:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.751810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635305.751852:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422026368:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.751871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635305.751897:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422025984 00000100:00100000:1.0:1789635305.751904:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422025984 00000100:00100000:1.0:1789635305.751952:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422026368 00000100:00100000:1.0:1789635305.751964:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422026368 00000100:00100000:1.0:1789635305.751992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789635305.752000:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422025984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.752046:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422025984:12345-0@lo:400:kworker.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.752052:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789635305.752075:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789635305.752081:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422026368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.752103:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422026368:12345-0@lo:400:kworker.0 Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.752109:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789635305.752124:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422025856 00000100:00100000:1.0:1789635305.752127:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422025856 00000100:00100000:1.0:1789635305.752148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789635305.752153:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422025856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.752188:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422025856:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.752194:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1789635305.752225:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635305.752235:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422026112:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.752255:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635305.752276:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635305.752287:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422026240:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.752350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635305.752375:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422026240 00000100:00100000:1.0:1789635305.752379:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422026240 00000100:00100000:1.0:1789635305.752405:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789635305.752410:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422026240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.752438:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422026240:12345-0@lo:400:kworker.0 Request processed in 28us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.752444:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789635305.752857:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635305.752868:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422026112 00000100:00100000:1.0:1789635305.752872:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422026112 00000100:00100000:1.0:1789635305.752898:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789635305.752904:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422026112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.753347:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422026112:12345-0@lo:400:kworker.0 Request processed in 266us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635305.753355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789635305.753376:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635305.753620:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422025856:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.753633:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422026368:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.753642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422025984:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.753678:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422026240:0@lo:400:kworker.0 00000100:00100000:1.0:1789635305.753688:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422026112:0@lo:400:kworker.0 00000001:00080000:2.0:1789635305.863151:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789635305.863178:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000040:00080000:1.0:1789635306.355198:0:12572:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635306.355206:0:12572:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635306.355247:0:12572:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789635306.355253:0:12572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789635306.487053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635306.487232:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410504576 00000100:00100000:2.0:1789635306.487243:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410504576 00000100:00100000:2.0:1789635306.487352:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:2.0:1789635306.487364:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+22:11511:x1876568410504576:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635306.487384:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635306.487404:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d31f expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.487658:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3997 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.487673:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3997 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.487687:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3997 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635306.487698:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789635306.487829:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d31f expref: 25 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.487845:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3997 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d31f expref: 24 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.487854:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635306.487857:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789635306.487861:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820e00, rc 0) 00000100:00100000:2.0:1789635306.487926:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+24:11511:x1876568410504576:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 564us (883us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789635306.487933:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:0.0:1789635306.491226:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635306.491649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410504704 00000100:00100000:2.0:1789635306.491660:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410504704 00000100:00100000:2.0:1789635306.491714:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:2.0:1789635306.491724:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:11511:x1876568410504704:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1789635306.491804:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.491825:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.491837:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.491851:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.491858:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.491865:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492095:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492104:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492111:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635306.492149:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492163:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492170:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492186:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492193:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635306.492198:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492206:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492231:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635306.492235:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635306.492240:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492247:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb39a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492257:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492264:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492269:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492275:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635306.492278:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492292:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492300:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91f3700) 00010000:00010000:2.0:1789635306.492303:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635306.492305:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492345:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb39ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492360:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492366:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492372:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492378:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635306.492381:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492387:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492394:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d91f3400) 00010000:00010000:2.0:1789635306.492396:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635306.492399:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.492414:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635306.492872:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:11511:x1876568410504704:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 1147us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635306.492881:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:2.0:1789635306.525594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635306.525780:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410504960 00000100:00100000:0.0:1789635306.525791:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410504960 00000100:00100000:0.0:1789635306.525850:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:0.0:1789635306.525862:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+24:11514:x1876568410504960:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635306.525884:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635306.525905:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb39ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d326 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.525987:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526023:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526037:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526044:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526051:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526463:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526473:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526481:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635306.526490:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789635306.526571:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526578:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526585:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526596:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635306.526600:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526608:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526619:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635306.526622:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635306.526627:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526634:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb39c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526651:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526657:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526663:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526669:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635306.526672:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526678:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526694:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d088e400) 00010000:00010000:0.0:1789635306.526696:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635306.526699:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526705:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb39c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526744:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb39ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526757:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.526763:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635306.526765:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635306.526768:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030a00, rc 0) 00000100:00100000:0.0:1789635306.526826:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:11514:x1876568410504960:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 966us (1242us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789635306.526834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:3.0:1789635306.530912:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635306.531115:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410505088 00000100:00100000:0.0:1789635306.531125:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410505088 00000100:00100000:0.0:1789635306.531233:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:0.0:1789635306.531245:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+26:11514:x1876568410505088:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1789635306.531333:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531351:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531369:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531394:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531400:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531408:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531414:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635306.531419:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531427:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531438:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635306.531453:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635306.531459:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.531465:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb39dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635306.531534:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+26:11514:x1876568410505088:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 291us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635306.531542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:0.0:1789635306.540152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635306.540207:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410505344 00000100:00100000:0.0:1789635306.540271:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410505344 00000100:00100000:0.0:1789635306.540341:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1789635306.540351:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+26:11514:x1876568410505344:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635306.541088:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+27:11514:x1876568410505344:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 736us (941us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789635306.541097:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00010000:00010000:1.0:1789635306.580434:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635306.586223:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635306.586298:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410505600 00000100:00100000:0.0:1789635306.586635:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410505600 00000100:00100000:1.0:1789635306.587013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:1.0:1789635306.587027:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+27:11039:x1876568410505600:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789635306.587053:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635306.587074:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb39e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d32d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.587183:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.587197:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.587207:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.587251:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.587266:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 28 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635306.587281:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422026496:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635306.587396:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad240 going to sleep for 11 seconds 00000100:00100000:1.0:1789635306.589384:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876568422026496:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635306.589421:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635306.590178:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635306.590372:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410505728 00000100:00100000:0.0:1789635306.590380:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410505728 00010000:00010000:0.0:1789635306.590419:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 29 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635306.590669:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1789635306.590680:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+29:2349:x1876568410505728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635306.590694:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635306.590701:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 29 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.590714:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 29 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.590734:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb39cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d326 expref: 29 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.590763:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:1.0:1789635306.590768:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.590776:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.590784:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.590812:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635306.590863:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+28:2349:x1876568410505728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 184us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635306.590871:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00010000:00010000:3.0:1789635306.591008:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635306.591016:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635306.591033:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789635306.591174:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb39e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635306.591189:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635306.591196:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:3.0:1789635306.591198:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635306.591200:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85e00, rc 0) 00000100:00100000:3.0:1789635306.591235:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+28:11039:x1876568410505600:12345-192.168.201.30@tcp:101:bash.0 Request processed in 4213us (5031us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789635306.591249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:3.0:1789635306.593897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635306.594021:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410505984 00000100:00100000:2.0:1789635306.594030:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410505984 00000100:00100000:2.0:1789635306.594420:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:2.0:1789635306.594431:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+28:11039:x1876568410505984:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:2.0:1789635306.594681:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.594698:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.594710:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635306.594774:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789635306.594802:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4e22245 reply state 000000009e4533c6 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635306.594811:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789635306.594857:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789635306.594973:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+32:11039:x1876568410505984:12345-192.168.201.30@tcp:36:bash.0 Request processed in 542us (1084us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789635306.594985:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 190 00000020:00080000:2.0:1789635306.595002:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789635306.598874:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1789635306.598976:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.598989:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.598997:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.599004:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635306.599009:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.599017:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.599034:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:2.0:1789635306.599038:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635306.599051:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.599058:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb39f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635306.599161:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410506112 00000100:00100000:3.0:1789635306.599171:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410506112 00000100:00100000:3.0:1789635306.599226:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:3.0:1789635306.599236:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+31:11039:x1876568410506112:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635306.599260:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635306.599275:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3a00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d334 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635306.599376:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d334 expref: 32 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635306.599388:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3a00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d334 expref: 32 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635306.599400:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:3.0:1789635306.599402:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635306.599404:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:3.0:1789635306.599454:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+32:11039:x1876568410506112:12345-192.168.201.30@tcp:101:bash.0 Request processed in 221us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635306.599459:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:3.0:1789635306.601907:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635306.602212:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410506240 00000100:00100000:1.0:1789635306.602221:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410506240 00000100:00100000:1.0:1789635306.602275:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:1.0:1789635306.602286:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:11039:x1876568410506240:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789635306.602303:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635306.602363:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d33b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635306.602389:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aabaae7, atime: 0x6aabaae5, ctime: 0x6aabaae7, blocks: 0xb 00010000:00010000:1.0:1789635306.602407:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=282s v=(0 0) 00010000:00010000:1.0:1789635306.602411:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635306.602420:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.602435:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.602458:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85200, rc 0) 00000100:00100000:1.0:1789635306.602509:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:11039:x1876568410506240:12345-192.168.201.30@tcp:101:bash.0 Request processed in 224us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635306.602516:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1789635306.608107:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635306.608305:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410506368 00000100:00100000:0.0:1789635306.608336:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410506368 00002000:00010000:0.0:1789635306.608373:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789635306.608377:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79dbcb1f80 with x1876568410506368 ext(0->18446744073709551615) 00002000:00010000:0.0:1789635306.608386:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79dbcb1f80. 00000100:00100000:0.0:1789635306.608411:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1789635306.608418:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2350:x1876568410506368:12345-192.168.201.30@tcp:10:bash.0 00002000:00010000:0.0:1789635306.608813:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789635306.608816:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789635303 -> 1789635308 00002000:00010000:0.0:1789635306.608818:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789635301 -> 1789635301 00002000:00010000:0.0:1789635306.608820:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789635303 -> 1789635308 00002000:00010000:0.0:1789635306.608821:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789635306.608874:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:2350:x1876568410506368:12345-192.168.201.30@tcp:10:bash.0 Request processed in 454us (776us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789635306.608894:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00002000:00010000:0.0:1789635306.608898:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789635306.608901:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79dbcb1f80 with x1876568410506368 ext(0->18446744073709551615) 00002000:00010000:0.0:1789635306.608905:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79dbcb1f80. 00000100:00100000:0.0:1789635306.669275:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635306.669755:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410506496 00000100:00100000:1.0:1789635306.669767:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410506496 00000100:00100000:1.0:1789635306.669826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:1.0:1789635306.669840:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+32:11528:x1876568410506496:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1789635306.669951:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.669971:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.669984:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670002:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670009:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670015:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670258:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670269:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670278:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635306.670342:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670353:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670369:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670376:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670382:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635306.670386:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670394:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670405:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:1.0:1789635306.670408:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635306.670413:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670419:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670431:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670437:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670454:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670460:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635306.670475:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670482:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670490:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d898af00) 00010000:00010000:1.0:1789635306.670492:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635306.670495:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670501:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670514:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670520:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670525:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670530:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635306.670533:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670538:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:1.0:1789635306.670548:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635306.670557:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.670563:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635306.670643:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+32:11528:x1876568410506496:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 806us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635306.670651:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:3.0:1789635306.768814:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635306.770379:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410506752 00000100:00100000:2.0:1789635306.770393:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410506752 00000100:00100000:2.0:1789635306.770477:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:2.0:1789635306.770488:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+32:11531:x1876568410506752:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635306.770510:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635306.770532:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3a23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d342 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770631:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770647:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770658:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770672:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770679:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770685:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770928:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3a38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770950:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.770958:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635306.770968:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789635306.771066:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771073:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771086:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771092:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635306.771097:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771832:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771849:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635306.771852:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635306.771857:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771863:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3a2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771877:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771882:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771888:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771893:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635306.771896:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771913:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771932:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d91f3400) 00010000:00010000:2.0:1789635306.771935:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635306.771948:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635306.771955:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3a31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.772272:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821000/0x77332204cfbb3a23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d342 expref: 35 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.772288:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d342 expref: 34 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.772295:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635306.772298:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789635306.772300:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821e00, rc 0) 00000100:00100000:0.0:1789635306.772404:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+34:11531:x1876568410506752:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1917us (3598us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789635306.772412:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:3.0:1789635306.780132:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635306.780394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410506880 00000100:00100000:1.0:1789635306.780405:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410506880 00000100:00100000:1.0:1789635306.780471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:1.0:1789635306.780482:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+34:11531:x1876568410506880:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1789635306.780547:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.780564:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.780584:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.780619:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.780635:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 34 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635306.780649:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422026624:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635306.780755:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad240 going to sleep for 11 seconds 00000100:00100000:1.0:1789635306.788186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635306.788301:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422026624:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635306.788358:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635306.788694:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410507136 00000100:00100000:3.0:1789635306.788715:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410507136 00000100:00100000:3.0:1789635306.788765:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789635306.788776:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+35:5581:x1876568410507136:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789635306.789139:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+36:5581:x1876568410507136:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 363us (961us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789635306.789147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:0.0:1789635306.803069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635306.805651:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410507264 00000100:00100000:1.0:1789635306.805666:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410507264 00010000:00010000:1.0:1789635306.805712:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 36 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635306.805761:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1789635306.805770:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+36:2348:x1876568410507264:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635306.805786:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635306.805794:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 36 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.805808:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 36 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.805830:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb39eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d32d expref: 36 pid: 5844 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.805845:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:1.0:1789635306.805850:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.805860:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.805868:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635306.805903:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635306.805980:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+35:2348:x1876568410507264:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 210us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635306.805987:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00010000:00010000:0.0:1789635306.806287:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806297:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806357:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806365:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806372:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806378:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635306.806382:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806389:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806398:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:0.0:1789635306.806405:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635306.806409:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635306.806415:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635306.806472:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+34:11531:x1876568410506880:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 25983us (26343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635306.806479:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:2.0:1789635306.815288:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635306.816798:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410507520 00000100:00100000:3.0:1789635306.816812:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410507520 00000100:00100000:3.0:1789635306.816867:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1789635306.816878:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+34:11531:x1876568410507520:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789635306.817152:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+35:11531:x1876568410507520:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 275us (1872us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789635306.817160:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:2.0:1789635307.110531:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.110886:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410507776 00000100:00100000:1.0:1789635307.110896:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410507776 00000100:00100000:1.0:1789635307.111021:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:1.0:1789635307.111033:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+35:11542:x1876568410507776:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:1.0:1789635307.111056:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635307.111077:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d349 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111148:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111163:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111187:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111201:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111208:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111214:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111512:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111521:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111527:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635307.111537:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789635307.111638:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111646:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111652:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111658:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.111662:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111669:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111680:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:1.0:1789635307.111682:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635307.111686:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111702:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111721:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111727:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111733:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111738:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.111741:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111746:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d898af00) 00010000:00010000:1.0:1789635307.111757:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635307.111759:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111764:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111804:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d349 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111817:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d349 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.111831:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:1.0:1789635307.111834:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635307.111836:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635307.111905:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+37:11542:x1876568410507776:12345-192.168.201.30@tcp:101:cat.0 Request processed in 874us (1385us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789635307.111912:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00080000:2.0:1789635307.112462:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635307.122783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635307.128853:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410508032 00000100:00100000:3.0:1789635307.128876:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410508032 00000100:00100000:3.0:1789635307.129783:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:3.0:1789635307.129803:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+37:11542:x1876568410508032:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:3.0:1789635307.130201:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+38:11542:x1876568410508032:12345-192.168.201.30@tcp:35:cat.0 Request processed in 404us (7426us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789635307.130212:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1789635307.153740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.153856:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410508288 00000100:00100000:1.0:1789635307.153870:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410508288 00000100:00100000:1.0:1789635307.153961:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:1.0:1789635307.153975:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+38:11543:x1876568410508288:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1789635307.154058:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789635307.154096:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3a62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d349 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154121:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb3a38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d342 expref: 37 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154147:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3a00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d334 expref: 36 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154159:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d088e500) 00010000:00010000:1.0:1789635307.154172:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635307.154201:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154241:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154253:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154270:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154278:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.154284:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.155025:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.155038:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.155046:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635307.168069:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789635307.168090:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282987778295ns, next at 283987772712ns, rc = 0 00010000:00010000:1.0:1789635307.168226:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168247:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168276:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168287:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168294:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168301:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168363:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635307.168396:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168403:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168409:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168416:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.168421:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168428:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168443:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d898ad00) 00010000:00010000:1.0:1789635307.168447:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789635307.168460:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.168466:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3a7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.169571:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635307.169591:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.169602:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635307.169607:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.169630:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.169648:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e79d898ad00) 00010000:00010000:3.0:1789635307.169651:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789635307.169654:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.169660:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3a85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.169688:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635307.169690:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635307.169692:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635307.171221:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.171239:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.171246:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.171252:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.171257:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.171265:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.171284:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:1.0:1789635307.171287:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635307.171292:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.171299:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3a70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789635307.176960:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c75ba7e reply state 000000003aef8cdd transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635307.177020:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635307.177191:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+37:11543:x1876568410508288:12345-192.168.201.30@tcp:36:rm.0 Request processed in 23212us (23459us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789635307.177201:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 196 00010000:00010000:0.0:1789635307.179369:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.179388:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.179412:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.179419:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635307.179423:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.179432:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.179450:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d898af00) 00010000:00010000:0.0:1789635307.179453:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635307.179457:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.179463:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3a77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635307.224989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635307.225104:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410508544 00000100:00100000:0.0:1789635307.225116:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410508544 00000100:00100000:0.0:1789635307.225184:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:0.0:1789635307.225196:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+36:11549:x1876568410508544:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635307.225220:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635307.225242:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3a8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d350 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.225561:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.225587:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.225601:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.225617:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.225623:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.225630:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635307.226125:0:7562:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789635307.226274:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226285:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226292:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226344:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226352:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226359:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226371:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635307.226376:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226385:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226398:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635307.226400:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635307.226404:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226411:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3a93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635307.226423:0:7562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002724fdd9 reply state 00000000f2234f91 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635307.226432:0:7562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789635307.226458:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3a8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 39 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226472:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 38 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.226479:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:0.0:1789635307.226481:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635307.226483:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030a00, rc 0) 00000100:00100000:0.0:1789635307.226555:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+39:11549:x1876568410508544:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1361us (1575us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789635307.226568:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:3.0:1789635307.229525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.229616:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410508672 00000100:00100000:1.0:1789635307.229625:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410508672 00000100:00100000:1.0:1789635307.229694:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1789635307.229705:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2350:x1876568410508672:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789635307.229724:0:8106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635307.229745:0:8106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d357 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789635307.229769:0:8106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789635307.229788:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=283s v=(0 0) 00010000:00010000:1.0:1789635307.229794:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635307.229803:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 6 pid: 8106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.229823:0:8106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 6 pid: 8106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.229837:0:8106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175800, rc 0) 00000100:00100000:1.0:1789635307.229892:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2350:x1876568410508672:12345-192.168.201.30@tcp:101:bash.0 Request processed in 188us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635307.229899:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00010000:00010000:2.0:1789635307.230061:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.230071:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.230078:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.230084:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635307.230089:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.230096:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.230117:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d088e400) 00010000:00010000:2.0:1789635307.230120:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635307.230124:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.230131:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3a9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789635307.230269:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635307.232282:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635307.232514:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410508800 00000100:00100000:2.0:1789635307.232524:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410508800 00000100:00100000:2.0:1789635307.232655:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:2.0:1789635307.232665:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:11549:x1876568410508800:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789635307.232681:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635307.232698:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d35e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.232727:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 7 pid: 8106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.232737:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635307.232741:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635307.232746:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.232782:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 7 pid: 8106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.232814:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 7 pid: 8106 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635307.232828:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7247800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1876568422026752:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635307.232917:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdafd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635307.235008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635307.235129:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7247800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1876568422026752:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635307.235169:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.235189:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820600, rc 0) 00000100:00100000:2.0:1789635307.235241:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:11549:x1876568410508800:12345-192.168.201.30@tcp:101:bash.0 Request processed in 2576us (2964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635307.235249:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1789635307.235995:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410508928 00000100:00100000:0.0:1789635307.236005:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410508928 00010000:00010000:0.0:1789635307.236037:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 7 pid: 8106 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635307.236117:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:0.0:1789635307.236127:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410508928:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635307.236140:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635307.236172:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 7 pid: 8106 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.236187:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 7 pid: 8106 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.236208:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961127e8/0x77332204cfbb3aaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d357 expref: 7 pid: 8106 timeout: 383 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.236222:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635307.236226:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635307.236235:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.236246:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.236297:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635307.236343:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2cb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876568422026880:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789635307.236406:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31780 going to sleep for 11 seconds 00000100:00100000:1.0:1789635307.240838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635307.241179:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410509184 00000100:00100000:2.0:1789635307.241190:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410509184 00000100:00100000:2.0:1789635307.241247:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:2.0:1789635307.241258:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+38:11549:x1876568410509184:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1789635307.241630:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+39:11549:x1876568410509184:12345-192.168.201.30@tcp:35:bash.0 Request processed in 372us (800us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789635307.241639:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789635307.245339:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2cb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876568422026880:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789635307.245373:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635307.245431:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410508928:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 9304us (10429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.245441:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:1.0:1789635307.381710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635307.381857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410509312 00000100:00100000:0.0:1789635307.381867:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410509312 00000100:00100000:0.0:1789635307.381923:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:0.0:1789635307.381944:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+39:11565:x1876568410509312:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635307.381970:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635307.381989:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3abd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d365 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.382050:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3ac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.382063:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.382075:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635307.382127:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789635307.382130:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635307.382158:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.382182:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3abd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d365 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.382199:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d365 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.382208:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635307.382211:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635307.382215:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030200, rc 0) 00000100:00100000:0.0:1789635307.382275:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+40:11565:x1876568410509312:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 333us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.382282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:1.0:1789635307.386580:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635307.386836:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410509568 00000100:00100000:3.0:1789635307.386846:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410509568 00000100:00100000:3.0:1789635307.386899:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:3.0:1789635307.386908:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+40:11565:x1876568410509568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635307.386942:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635307.386963:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3acb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d36c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.387056:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.387069:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.387097:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635307.387109:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789635307.387240:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3acb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d36c expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.387257:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d36c expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.387266:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:3.0:1789635307.387269:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635307.387272:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72a00, rc 0) 00000100:00100000:3.0:1789635307.387513:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+42:11565:x1876568410509568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 604us (941us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789635307.387520:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:2.0:1789635307.394961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635307.395071:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.395402:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410509952 00000100:00100000:1.0:1789635307.395414:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410509952 00000100:00100000:1.0:1789635307.395473:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1789635307.395483:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+42:2351:x1876568410509952:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635307.395499:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635307.395523:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72a00/0x77332204cfbb3ad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d36c expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.395541:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:1.0:1789635307.395546:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635307.395605:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+41:2351:x1876568410509952:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 123us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635307.395613:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789635307.395848:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410509824 00000100:00100000:0.0:1789635307.395853:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410509824 00000100:00100000:0.0:1789635307.395887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:0.0:1789635307.395895:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+41:11565:x1876568410509824:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635307.395914:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635307.395940:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3ae0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d373 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.396029:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3ae7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.396055:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.396065:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635307.396078:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789635307.396207:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3ae0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d373 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.396379:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d373 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.396389:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:0.0:1789635307.396392:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789635307.396394:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030e00, rc 0) 00000100:00100000:0.0:1789635307.396421:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+43:11565:x1876568410509824:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 527us (1470us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789635307.396427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:1.0:1789635307.407824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635307.407909:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410510080 00000100:00100000:2.0:1789635307.407943:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410510080 00000100:00100000:2.0:1789635307.408022:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1789635307.408034:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+6:2348:x1876568410510080:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:2.0:1789635307.408077:0:8106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.408100:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.408108:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635307.408112:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789635307.408117:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.408249:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.408266:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 6 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635307.408281:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7245880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422027008:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635307.408523:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da0246c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635307.411561:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7245880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8106:1876568422027008:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635307.411590:0:8106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635307.413032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635307.413161:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410510208 00000100:00100000:2.0:1789635307.413169:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410510208 00002000:00100000:2.0:1789635307.413217:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e79dc079180 x1876568410510208/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:683/0 lens 504/0 e 0 to 0 dl 1789635318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635307.413228:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79dc079180 with x1876568410510208 ext(0->8) 00010000:00010000:2.0:1789635307.413251:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 7 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.413267:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 7 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635307.413275:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79dc079180 00000100:00100000:2.0:1789635307.413307:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1789635307.413338:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410510208:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:2.0:1789635307.413985:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410510208:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 646us (956us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789635307.413994:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00002000:00100000:2.0:1789635307.414002:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e79dc079180 x1876568410510208/t4294967308(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:683/0 lens 504/448 e 0 to 0 dl 1789635318 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635307.414011:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79dc079180 with x1876568410510208 ext(0->8) 00010000:00010000:2.0:1789635307.414017:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 9 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635307.414030:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 9 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635307.414037:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e79dc079180 00000100:00100000:2.0:1789635307.416646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635307.416724:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410510336 00000100:00100000:3.0:1789635307.416742:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410510336 00010000:00010000:3.0:1789635307.416778:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 9 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635307.416821:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:3.0:1789635307.416831:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:2348:x1876568410510336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635307.416844:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789635307.416863:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789635307.416865:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789635308 00002000:00010000:3.0:1789635307.416878:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789635308 00002000:00010000:3.0:1789635307.416881:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789635308 00010000:00010000:3.0:1789635307.416887:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 9 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.416901:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 9 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.416923:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4a5abe6/0x77332204cfbb3ab6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d35e expref: 9 pid: 6694 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.416953:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635307.416958:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635307.416964:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.416975:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.417008:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635307.417059:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410510336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 229us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635307.417066:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00010000:00010000:1.0:1789635307.417229:0:8106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417251:0:8106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417275:0:8106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417284:0:8106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417292:0:8106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417298:0:8106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635307.417303:0:8106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417358:0:8106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417371:0:8106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.417379:0:8106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3af5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635307.417433:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410510080:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 9401us (9618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635307.417440:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1789635307.419393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635307.419545:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410510592 00000100:00100000:2.0:1789635307.419553:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410510592 00000100:00100000:2.0:1789635307.419604:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1789635307.419623:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+43:11565:x1876568410510592:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:2.0:1789635307.419678:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d373 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635307.420006:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1789635307.420047:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789635307.421074:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1789635307.421140:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.421214:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 47 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.421301:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.422555:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 47 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.422570:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 47 pid: 7562 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635307.422586:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876568422027136:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635307.422754:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31840 going to sleep for 11 seconds 00000100:00100000:0.0:1789635307.425844:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876568422027136:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635307.425871:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635307.426134:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635307.426526:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410510720 00000100:00100000:3.0:1789635307.426535:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410510720 00010000:00010000:3.0:1789635307.426571:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 48 pid: 7562 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635307.426665:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1789635307.426675:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79d00c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+48:2349:x1876568410510720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635307.426690:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635307.426697:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 48 pid: 7562 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.426709:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 48 pid: 7562 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.426741:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030a00/0x77332204cfbb3aa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d350 expref: 48 pid: 7562 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.426756:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:3.0:1789635307.426761:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.426770:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.426777:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635307.426882:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635307.426945:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79d00c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+47:2349:x1876568410510720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 269us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635307.426952:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00010000:00010000:1.0:1789635307.427857:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.427869:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635307.428003:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789635307.428617:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1789635307.428722:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc078700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422027264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789635307.428840:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635307.428900:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635307.428950:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422027264 00000100:00100000:3.0:1789635307.428970:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422027264 00000100:00100000:3.0:1789635307.429083:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635307.429092:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422027264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789635307.429528:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422027264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 436us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635307.429536:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789635307.429593:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1789635307.429598:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1789635307.429615:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79e7edaa00, transno 4294967307 00000100:00100000:1.0:1789635307.429636:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc078700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422027264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789635307.430038:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789635307.430096:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc078700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422027392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789635307.430127:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635307.430154:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635307.430582:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422027392 00000100:00100000:0.0:1789635307.430589:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422027392 00000100:00100000:0.0:1789635307.430628:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635307.430635:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876568422027392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789635307.430857:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876568422027392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (728us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789635307.430864:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635307.430938:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc078700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876568422027392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789635307.430985:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789635307.431019:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.431037:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.431045:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.431051:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.431056:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.431064:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.431080:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:1.0:1789635307.431084:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789635307.431088:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.431094:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3afc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789635307.431419:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789635307.431487:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789635307.431497:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 283251184797ns, next at 284251183123ns, rc = 0 00000001:00080000:1.0:1789635307.431503:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789635307.431531:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ee00) 00010000:00010000:1.0:1789635307.431534:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789635307.431541:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3ae7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d373 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635307.431637:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+50:11565:x1876568410510592:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 12015us (12250us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789635307.431644:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000020:00080000:1.0:1789635307.431648:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789635307.433885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635307.434122:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410510848 00000100:00100000:0.0:1789635307.434132:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410510848 00000100:00100000:0.0:1789635307.434229:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:0.0:1789635307.434239:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+50:11565:x1876568410510848:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635307.434259:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635307.434278:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3b03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d37a expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.434368:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3b03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d37a expref: 51 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.434382:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3b03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d37a expref: 51 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.434398:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635307.434401:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635307.434404:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030800, rc 0) 00000100:00100000:0.0:1789635307.434454:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+51:11565:x1876568410510848:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 217us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.434461:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00080000:2.0:1789635307.434903:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635307.437060:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635307.437158:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410511104 00000100:00100000:0.0:1789635307.437165:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410511104 00000100:00100000:0.0:1789635307.437612:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:0.0:1789635307.437626:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+51:11565:x1876568410511104:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789635307.437845:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:11565:x1876568410511104:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 222us (791us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789635307.442990:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1789635307.541764:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635307.541838:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410511232 00000100:00100000:0.0:1789635307.541849:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410511232 00000100:00100000:0.0:1789635307.541915:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:0.0:1789635307.541938:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:11575:x1876568410511232:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1789635307.542013:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542057:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542071:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542089:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542103:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542191:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542199:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542206:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635307.542247:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542261:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542267:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542283:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542289:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635307.542294:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542302:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542333:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635307.542336:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635307.542341:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542347:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3b0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542362:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542369:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542375:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542380:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635307.542383:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542401:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542410:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d088ed00) 00010000:00010000:0.0:1789635307.542412:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635307.542415:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542420:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542448:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542454:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542459:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542464:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635307.542467:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542472:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542479:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635307.542481:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635307.542484:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.542500:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635307.542578:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+52:11575:x1876568410511232:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 653us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.542586:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 202 00010000:00010000:3.0:1789635307.603998:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635307.635136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.635265:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410511488 00000100:00100000:1.0:1789635307.635276:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410511488 00000100:00100000:1.0:1789635307.635364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:1.0:1789635307.635377:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+52:11578:x1876568410511488:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789635307.635400:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635307.635421:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d381 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635494:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635511:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635522:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635536:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635542:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635547:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635693:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635702:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635708:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635307.635717:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789635307.635822:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635829:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635837:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635842:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.635847:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635854:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635866:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:1.0:1789635307.635869:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635307.635873:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635888:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3b26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635902:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635908:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635913:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635917:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.635920:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635937:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635944:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d898a100) 00010000:00010000:1.0:1789635307.635947:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635307.635949:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635955:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.635992:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d381 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.636005:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d381 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.636019:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635307.636021:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635307.636024:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84600, rc 0) 00000100:00100000:1.0:1789635307.636093:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+54:11578:x1876568410511488:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 718us (965us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789635307.636100:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:3.0:1789635307.644989:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635307.645221:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410511616 00000100:00100000:0.0:1789635307.645232:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410511616 00000100:00100000:0.0:1789635307.645301:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:0.0:1789635307.645342:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+54:11578:x1876568410511616:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1789635307.645405:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645421:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645433:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645457:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645464:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645471:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645477:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635307.645481:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645502:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645515:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635307.645518:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635307.645522:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.645527:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635307.645918:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+54:11578:x1876568410511616:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 605us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635307.645943:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:2.0:1789635307.650304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.650607:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410511872 00000100:00100000:1.0:1789635307.650618:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410511872 00000100:00100000:1.0:1789635307.650680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:1.0:1789635307.650691:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+54:11578:x1876568410511872:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789635307.650957:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+55:11578:x1876568410511872:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 266us (674us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789635307.650964:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:3.0:1789635307.785431:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635307.785948:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410512128 00000100:00100000:0.0:1789635307.785960:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410512128 00000100:00100000:0.0:1789635307.786025:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:0.0:1789635307.786037:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+55:11587:x1876568410512128:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789635307.786063:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635307.786066:0:7562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635307.786092:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030200/0x77332204cfbb3ac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d365 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.786111:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635307.786117:0:7562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635307.786130:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d388 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.786269:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.786283:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.786292:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635307.786302:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789635307.786489:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030400/0x77332204cfbb3b49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d388 expref: 57 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.786503:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d388 expref: 56 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.786511:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635307.786514:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635307.786517:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030e00, rc 0) 00000100:00100000:0.0:1789635307.787161:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+56:11587:x1876568410512128:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1124us (1738us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789635307.787170:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:2.0:1789635307.793726:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.793811:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410512384 00000100:00100000:1.0:1789635307.793821:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410512384 00000100:00100000:1.0:1789635307.793878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 206 00000100:00100000:1.0:1789635307.793888:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+56:11587:x1876568410512384:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:1.0:1789635307.793973:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789635307.793999:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030e00/0x77332204cfbb3b50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d388 expref: 56 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.794022:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d381 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.794034:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635307.794046:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635307.794274:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.794288:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.794298:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635307.794398:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789635307.794425:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076af24ba reply state 000000009fec2329 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635307.794435:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789635307.794526:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+57:11587:x1876568410512384:12345-192.168.201.30@tcp:36:bash.0 Request processed in 638us (809us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789635307.794534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 206 00000020:00080000:1.0:1789635307.794539:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789635307.800973:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.800991:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.800999:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.801019:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635307.801025:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.801032:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.801059:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635307.801063:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635307.801069:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635307.801075:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635307.809532:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.809679:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410512512 00000100:00100000:1.0:1789635307.809690:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410512512 00000100:00100000:1.0:1789635307.809756:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:1.0:1789635307.809766:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+56:11587:x1876568410512512:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789635307.809791:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635307.809810:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d38f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.809887:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.809902:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.809937:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635307.809968:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789635307.809972:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635307.809991:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.810016:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.810033:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.810043:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635307.810046:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635307.810049:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85e00, rc 0) 00000100:00100000:1.0:1789635307.810103:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+57:11587:x1876568410512512:12345-192.168.201.30@tcp:101:bash.0 Request processed in 339us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635307.810110:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:3.0:1789635307.816051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.816345:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410512768 00000100:00100000:1.0:1789635307.816357:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410512768 00000100:00100000:1.0:1789635307.816411:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1789635307.816422:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+57:11587:x1876568410512768:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:1.0:1789635307.816794:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+58:11587:x1876568410512768:12345-192.168.201.30@tcp:35:bash.0 Request processed in 372us (759us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789635307.816804:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000040:00080000:1.0:1789635307.923526:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635307.923537:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635307.923587:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789635307.923595:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635307.986658:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.986908:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410512896 00000100:00100000:1.0:1789635307.986930:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410512896 00000100:00100000:1.0:1789635307.986991:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00100000:1.0:1789635307.987003:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+58:11594:x1876568410512896:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789635307.987026:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635307.987047:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d396 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.987113:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.987127:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.987147:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635307.987179:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789635307.987183:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635307.987198:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.987230:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d396 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.987249:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d396 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.987270:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:1.0:1789635307.987273:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635307.987277:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635307.987394:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+59:11594:x1876568410512896:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 393us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635307.987401:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00100000:2.0:1789635307.997903:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635307.999374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410513024 00000100:00100000:1.0:1789635307.999388:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410513024 00000100:00100000:1.0:1789635307.999444:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:1.0:1789635307.999453:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+59:11594:x1876568410513024:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789635307.999475:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635307.999497:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d39d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999583:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999599:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999609:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999622:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999629:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999651:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999752:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999760:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999767:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635307.999799:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789635307.999802:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635307.999820:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999832:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999840:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999845:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999851:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999857:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.999861:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999875:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999888:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:1.0:1789635307.999891:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635307.999895:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999900:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85800/0x77332204cfbb3b88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999928:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999934:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999940:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999945:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635307.999948:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999954:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999961:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79d898a100) 00010000:00010000:1.0:1789635307.999963:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635307.999966:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635307.999982:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3b8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.000017:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3b81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.000031:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.000050:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635308.000053:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635308.000056:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175800, rc 0) 00000100:00100000:1.0:1789635308.000138:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+60:11594:x1876568410513024:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 678us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635308.000146:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:3.0:1789635308.006631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635308.010891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635308.014663:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410513408 00000100:00100000:3.0:1789635308.014679:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410513408 00000100:00100000:3.0:1789635308.014755:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:3.0:1789635308.014766:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+60:11594:x1876568410513408:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635308.014788:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635308.014808:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3b9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.014904:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.014932:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.014960:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.014969:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.015002:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.015016:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 61 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635308.015030:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c73bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422027520:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635308.015164:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.015174:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 61 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635308.015184:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422027648:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635308.015208:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ecc4a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635308.025045:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410513152 00000100:00100000:0.0:1789635308.025061:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410513152 00010000:00010000:0.0:1789635308.025110:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 62 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635308.025158:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:0.0:1789635308.025169:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+62:2349:x1876568410513152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635308.025184:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635308.025191:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 62 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.025205:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 62 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.025252:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635308.025257:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.025265:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.025271:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635308.025355:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+62:2349:x1876568410513152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 187us (18734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635308.025362:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:2.0:1789635308.050567:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635308.050671:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410513536 00000100:00100000:0.0:1789635308.050682:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410513536 00010000:00010000:0.0:1789635308.050722:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 62 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635308.050779:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:0.0:1789635308.050789:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+62:2349:x1876568410513536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635308.050825:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635308.050834:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 62 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.050847:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 62 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.050869:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635308.050874:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.050890:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.050898:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.050927:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635308.050982:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+62:2349:x1876568410513536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 194us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635308.050991:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00010000:00010000:3.0:1789635308.051900:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.30@tcp) returned -22 from blocking AST (req@000000004d3f8a3f x1876568422027520) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 61 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.051932:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3b96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d39d expref: 61 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635308.051961:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c73bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422027520:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635308.051977:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3b6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d38f expref: 60 pid: 5844 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635308.051987:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422027648:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635308.052006:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635308.052012:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.052021:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.052027:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635308.052045:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789635308.052204:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3b9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.052219:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.052226:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635308.052229:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635308.052231:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73200, rc 0) 00000100:00100000:3.0:1789635308.052286:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+60:11594:x1876568410513408:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 37521us (41403us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789635308.052928:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:2.0:1789635308.067365:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635308.067465:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410513792 00000100:00100000:0.0:1789635308.067476:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410513792 00000100:00100000:0.0:1789635308.067542:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789635308.067552:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+60:11594:x1876568410513792:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:0.0:1789635308.067566:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635308.067597:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3b03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d37a expref: 60 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.067615:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635308.067620:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635308.067667:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+59:11594:x1876568410513792:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 117us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635308.067675:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1789635308.077220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635308.077382:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410513920 00000100:00100000:1.0:1789635308.077395:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410513920 00000100:00100000:1.0:1789635308.077453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:1.0:1789635308.077464:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+59:11594:x1876568410513920:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:1.0:1789635308.077565:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.077593:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.077604:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635308.077819:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789635308.077910:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+59:11594:x1876568410513920:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 447us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635308.077926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:3.0:1789635308.084548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635308.085570:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410514048 00000100:00100000:1.0:1789635308.085594:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410514048 00000100:00100000:1.0:1789635308.085655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:1.0:1789635308.085667:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+59:11594:x1876568410514048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789635308.085689:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635308.085711:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3ab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.085783:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.085794:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.085815:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.085827:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.085840:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635308.085844:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635308.085847:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.085869:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02175600, rc 0) 00000100:00100000:1.0:1789635308.085946:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c73bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+60:11594:x1876568410514048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 281us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635308.085954:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 212 00010000:00010000:1.0:1789635308.627652:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789635308.920839:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000001:00080000:3.0:1789635308.920869:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:3.0:1789635308.920884:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789635308.920912:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79fe2ad300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789635308.920917:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79fdff3200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79fe2adc00 00000020:00080000:3.0:1789635308.920920:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79fdff3600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79e7b3ec00 00000004:00080000:3.0:1789635308.920938:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789635308.920950:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79fe2ad840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789635308.920953:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79fe624f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79fe2ad900 00000020:00080000:3.0:1789635308.920955:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79fe624000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79c80aa000 00000020:00080000:3.0:1789635308.920968:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1789635308.920993:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000020:00080000:3.0:1789635308.921138:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1789635308.921672:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635308.921695:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422027776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789635308.921764:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635308.921834:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422027776 00000100:00100000:0.0:1789635308.921854:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422027776 00000100:00100000:0.0:1789635308.921922:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789635308.921931:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876568422027776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789635308.921958:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1789635308.921991:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aabaaec, atime: 0x6aabaaec, ctime: 0x6aabaaec, blocks: 0x1 00010000:00010000:0.0:1789635308.921999:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.922016:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789635308.922020:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635308.922027:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.922055:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.922066:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.922075:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.922093:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1789635308.922568:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789635308.926133:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422027904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789635308.926203:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635308.926788:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422027904 00000100:00100000:0.0:1789635308.926797:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422027904 00000100:00100000:0.0:1789635308.926858:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635308.926869:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876568422027904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789635308.926923:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1789635308.926950:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.926972:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.926980:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789635308.926984:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635308.926988:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.927034:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.927049:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 8 pid: 6694 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635308.927062:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876568422028032:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635308.927127:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa9780 going to sleep for 11 seconds 00010000:00010000:0.0:1789635308.927148:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635308.927155:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.927163:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635308.927168:0:7641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.927185:0:7641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.927204:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.927211:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3bc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635308.927233:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635308.927235:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635308.927236:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635308.927720:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876568422027776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5789us (5953us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789635308.927729:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1789635308.927772:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79c8a52680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789635308.927777:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422027776:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789635308.927858:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635308.931504:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876568422028032:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635308.931541:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635308.940800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635308.941203:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410514176 00000100:00100000:3.0:1789635308.941215:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410514176 00010000:00010000:3.0:1789635308.941270:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 9 pid: 6694 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635308.941340:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:3.0:1789635308.941358:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+9:2348:x1876568410514176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635308.941378:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635308.941384:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 9 pid: 6694 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.941400:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 9 pid: 6694 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.941424:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3a07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d33b expref: 9 pid: 6694 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.941597:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635308.941602:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635308.941608:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.941621:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.941669:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635308.941738:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410514176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 384us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635308.941745:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00010000:00010000:1.0:1789635308.941801:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.941813:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.941824:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.941832:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.941854:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789635308.942504:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422027904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15636us (16300us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789635308.942512:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1789635308.942867:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635308.942874:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.942883:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635308.942888:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.942906:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.942921:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.942928:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59dfc6d/0x77332204cfbb3bc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635308.942947:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635308.942949:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635308.942951:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789635308.943239:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79c8a53b80/2, rc 0, transno 4294967319 00000100:00100000:3.0:1789635308.943249:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422027904:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1789635308.948077:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1789635308.950890:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635308.950911:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635308.950978:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789635308.950984:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789635308.952500:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a52a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422028160:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789635308.952592:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca5d0f00 going to sleep for 11 seconds 00000001:00080000:0.0:1789635308.954205:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:0.0:1789635308.954231:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:3.0:1789635308.964942:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a52a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422028160:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635308.967240:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635308.967397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410514304 00000100:00100000:1.0:1789635308.967408:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410514304 00000100:00100000:1.0:1789635308.967457:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:1.0:1789635308.967466:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:11595:x1876568410514304:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789635308.967512:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789635308.967611:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:11595:x1876568410514304:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 139us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635308.967618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:2.0:1789635308.975575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635308.975679:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410514432 00000100:00100000:1.0:1789635308.975690:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410514432 00000100:00100000:1.0:1789635308.975765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:1.0:1789635308.975776:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+18:11595:x1876568410514432:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789635308.975856:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975875:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975888:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975917:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975926:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975933:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975956:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975965:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.975987:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635308.976026:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789635308.976030:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635308.976043:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976054:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976060:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976068:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976073:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635308.976077:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976084:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:1.0:1789635308.976098:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635308.976102:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976108:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175800/0x77332204cfbb3bce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976146:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976153:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976159:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976165:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635308.976168:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976173:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976181:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9e79d898a400) 00010000:00010000:1.0:1789635308.976183:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635308.976185:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976190:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bd5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976204:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976209:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976214:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976224:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635308.976227:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976233:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976240:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635308.976242:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635308.976244:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.976249:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3bdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635308.976551:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+18:11595:x1876568410514432:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 775us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635308.976558:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:2.0:1789635308.989447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635308.989597:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410514688 00000100:00100000:1.0:1789635308.989607:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410514688 00000100:00100000:1.0:1789635308.989670:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:1.0:1789635308.989681:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:11595:x1876568410514688:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635308.989701:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635308.989732:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3be3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3b2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.989830:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.989862:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.989873:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635308.989885:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789635308.990095:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990104:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990293:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990304:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635308.990308:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990350:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990364:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635308.990367:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789635308.990371:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990377:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb3bea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990417:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3be3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3b2 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990434:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:1.0:1789635308.990437:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789635308.990440:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3be3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3b2 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635308.990449:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85e00, rc 0) 00000100:00100000:1.0:1789635308.990518:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410514688:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 838us (1081us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789635308.990525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:2.0:1789635308.993686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635308.993838:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410514816 00000100:00100000:3.0:1789635308.993847:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410514816 00000100:00100000:3.0:1789635308.993912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:3.0:1789635308.993922:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410514816:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789635308.993958:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789635308.994071:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410514816:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 150us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635308.994079:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:2.0:1789635309.013228:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.013308:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410515072 00000100:00100000:0.0:1789635309.013332:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410515072 00000100:00100000:0.0:1789635309.013398:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:0.0:1789635309.013409:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410515072:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635309.013429:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635309.013432:0:7562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789635309.013469:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3b7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d396 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.013486:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:0.0:1789635309.013491:0:7562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635309.013503:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3bf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3b9 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789635309.014241:0:7562:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789635309.014545:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.014559:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.014571:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.014625:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3bf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3b9 expref: 21 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.014639:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3b9 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.014646:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79d088e200) 00010000:00010000:0.0:1789635309.014648:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635309.014651:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031000, rc 0) 00000100:00100000:0.0:1789635309.014715:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+20:11595:x1876568410515072:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1308us (1496us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789635309.014733:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00080000:2.0:1789635309.015594:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635309.021839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635309.024130:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410515328 00000100:00100000:3.0:1789635309.024145:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410515328 00000100:00100000:3.0:1789635309.024220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:3.0:1789635309.024231:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:11595:x1876568410515328:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789635309.024304:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635309.024356:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031000/0x77332204cfbb3bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3b9 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.024375:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79d088e200) 00010000:00010000:3.0:1789635309.024384:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635309.024416:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.024431:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.024441:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027210:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027232:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027244:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027480:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027489:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027496:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027502:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635309.027507:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027515:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027537:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:3.0:1789635309.027540:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635309.027544:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027551:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027562:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027568:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027574:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027579:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635309.027582:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027587:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027593:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x87d12097 (ffff9e79cdb4bd00) 00010000:00010000:3.0:1789635309.027596:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635309.027599:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.027605:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x87d12097 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635309.027713:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410515328:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 3479us (5880us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789635309.027722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:2.0:1789635309.031598:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635309.033269:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410515456 00000100:00100000:3.0:1789635309.033281:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410515456 00000100:00100000:3.0:1789635309.033363:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:3.0:1789635309.033374:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410515456:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635309.033397:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635309.033422:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3c0 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.033461:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.033474:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.033485:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.033578:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 21 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.033596:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.033619:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:3.0:1789635309.033628:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635309.033631:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73000, rc 0) 00000100:00100000:3.0:1789635309.033694:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+20:11595:x1876568410515456:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 320us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635309.033701:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:2.0:1789635309.040478:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.041437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410515712 00000100:00100000:0.0:1789635309.041449:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410515712 00000100:00100000:0.0:1789635309.041505:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:0.0:1789635309.041515:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:11595:x1876568410515712:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789635309.041599:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.041617:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.041628:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789635309.041921:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789635309.041940:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284861627688ns, next at 285861625461ns, rc = 0 00000004:00010000:0.0:1789635309.042240:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d5d5cec reply state 00000000d307744a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.042252:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635309.042438:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:11595:x1876568410515712:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 922us (1968us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789635309.042446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 220 00010000:00010000:1.0:1789635309.048723:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.048739:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.048747:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.048753:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635309.048758:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.048765:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.048783:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:1.0:1789635309.048786:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789635309.048802:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.048809:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635309.049565:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635309.049677:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410515840 00000100:00100000:3.0:1789635309.049688:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410515840 00000100:00100000:3.0:1789635309.049742:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:3.0:1789635309.049753:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+21:11595:x1876568410515840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635309.049775:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635309.049793:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3c7 expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.049849:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 22 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.049863:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 22 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.049880:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:3.0:1789635309.049883:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635309.049886:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73800, rc 0) 00000100:00100000:3.0:1789635309.049960:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+22:11595:x1876568410515840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 209us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635309.049967:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:2.0:1789635309.052542:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.052647:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410515968 00000100:00100000:0.0:1789635309.052656:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410515968 00000100:00100000:0.0:1789635309.052710:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1789635309.052721:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+6:2349:x1876568410515968:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789635309.053185:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410515968:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 464us (648us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789635309.053202:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:2.0:1789635309.057631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.058010:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410516224 00000100:00100000:0.0:1789635309.058029:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410516224 00000100:00100000:0.0:1789635309.058085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1789635309.058097:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:11595:x1876568410516224:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789635309.058377:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:11595:x1876568410516224:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 282us (753us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789635309.058385:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1789635309.073123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635309.073283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410516480 00000100:00100000:1.0:1789635309.073294:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410516480 00000100:00100000:1.0:1789635309.073380:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:1.0:1789635309.073390:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+23:11595:x1876568410516480:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789635309.073500:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+23:11595:x1876568410516480:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 111us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635309.073508:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:2.0:1789635309.077497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635309.077586:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410516608 00000100:00100000:3.0:1789635309.077596:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410516608 00000100:00100000:3.0:1789635309.077670:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:3.0:1789635309.077681:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+23:11595:x1876568410516608:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635309.077713:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635309.077735:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3ce expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.077808:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.077822:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.077833:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635309.077870:0:7562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635309.077889:0:7562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.077935:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ce expref: 25 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.077954:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ce expref: 24 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.077962:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:3.0:1789635309.077965:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789635309.077968:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73a00, rc 0) 00000100:00100000:3.0:1789635309.078205:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+24:11595:x1876568410516608:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 525us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635309.078223:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:2.0:1789635309.086412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.086603:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410516736 00000100:00100000:0.0:1789635309.086614:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410516736 00000100:00100000:0.0:1789635309.086661:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1789635309.086671:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410516736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635309.086689:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635309.086721:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3d5 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635309.086747:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabaaee, blocks: 0x1 00010000:00010000:0.0:1789635309.086767:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=284s v=(0 0) 00010000:00010000:0.0:1789635309.086772:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635309.086782:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.086798:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.086829:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030c00, rc 0) 00000100:00100000:0.0:1789635309.086889:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410516736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 219us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635309.086909:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1789635309.101994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635309.104855:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410516992 00000100:00100000:1.0:1789635309.104872:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410516992 00000100:00100000:1.0:1789635309.105012:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:1.0:1789635309.105092:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:11595:x1876568410516992:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789635309.106138:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+24:11595:x1876568410516992:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 1112us (4208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635309.106147:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:2.0:1789635309.146827:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635309.147001:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410517120 00000100:00100000:1.0:1789635309.147014:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410517120 00000100:00100000:1.0:1789635309.147088:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1789635309.147099:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:11595:x1876568410517120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635309.147132:0:8106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635309.147153:0:8106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3dc expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.147203:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.147213:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635309.147217:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635309.147222:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 9 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.147271:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.147287:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 9 pid: 6691 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635309.147302:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422028288:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635309.147433:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ada80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635309.158190:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422028288:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635309.158239:0:8106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 9 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.158262:0:8106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85e00, rc 0) 00000100:00100000:1.0:1789635309.158378:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:11595:x1876568410517120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 11281us (11559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635309.158386:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1789635309.159886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.160100:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410517248 00000100:00100000:0.0:1789635309.160124:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410517248 00010000:00010000:0.0:1789635309.160162:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 9 pid: 6691 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.160203:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:0.0:1789635309.160214:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+9:2349:x1876568410517248:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635309.160243:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635309.160267:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 9 pid: 6691 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.160282:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 9 pid: 6691 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.160304:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e66286a/0x77332204cfbb3c45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3d5 expref: 9 pid: 6691 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.160338:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635309.160342:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635309.160349:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.160371:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.160408:0:6707:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.160422:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6707:1876568422028416:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789635309.160491:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635309.168220:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6707:1876568422028416:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789635309.168262:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635309.168353:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410517248:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8140us (8470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635309.168365:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789635309.187639:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635309.187741:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410517376 00000100:00100000:2.0:1789635309.187751:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410517376 00002000:00100000:2.0:1789635309.187797:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9e79c8a53100 x1876568410517376/t0(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:685/0 lens 504/0 e 0 to 0 dl 1789635320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635309.187807:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79c8a53100 with x1876568410517376 ext(0->12) 00002000:00010000:2.0:1789635309.187812:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79c8a53100 00000100:00100000:2.0:1789635309.187841:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789635309.187850:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410517376:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789635309.188346:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e05ee327-d920-4885-acb2-a26d789e134c+10:2348:x1876568410517376:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 493us (713us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789635309.188356:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00002000:00100000:2.0:1789635309.188364:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9e79c8a53100 x1876568410517376/t4294967321(0) o4->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:685/0 lens 504/448 e 0 to 0 dl 1789635320 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789635309.188372:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79c8a53100 with x1876568410517376 ext(0->12) 00002000:00010000:2.0:1789635309.188376:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79c8a53100 00000100:00100000:2.0:1789635309.198843:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635309.199012:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410517504 00000100:00100000:1.0:1789635309.199023:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410517504 00000100:00100000:1.0:1789635309.199095:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 225 00000100:00100000:1.0:1789635309.199460:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+24:11595:x1876568410517504:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789635309.333432:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635309.333461:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422028544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635309.333529:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635309.334256:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422028544 00000100:00100000:2.0:1789635309.334267:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422028544 00000100:00100000:2.0:1789635309.334358:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789635309.334370:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422028544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635309.334422:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635309.334474:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422028544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635309.334481:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789635309.334587:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422028544:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789635309.336845:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635309.381766:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+24:11595:x1876568410517504:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 182641us (182921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635309.381785:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 225 00000001:00080000:0.0:1789635309.382532:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1789635309.382543:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1789635309.382569:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1789635309.382823:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635309.382841:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422028672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789635309.382903:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635309.382973:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422028672 00000100:00100000:3.0:1789635309.382980:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422028672 00000100:00100000:3.0:1789635309.389121:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789635309.389147:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876568422028672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789635309.389363:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789635309.389368:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789635310 00002000:00010000:3.0:1789635309.389370:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789635309.389373:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789635310 -> 1789635310 00002000:00010000:3.0:1789635309.389375:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789635309.389456:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876568422028672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 320us (6563us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789635309.389464:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789635309.389569:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1789635309.389576:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1789635309.389600:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e79c8a53b80 x1876568422027904/t4294967319(4294967319) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789635324 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789635309.389612:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79e7b66a00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789635309.389617:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422028672:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789635309.389748:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1789635309.389762:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1789635309.422815:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.422935:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410517632 00000100:00100000:0.0:1789635309.422945:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410517632 00000100:00100000:0.0:1789635309.423022:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:0.0:1789635309.423034:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+10:2351:x1876568410517632:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789635309.597302:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+10:2351:x1876568410517632:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 174259us (174486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635309.597335:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000001:00080000:3.0:1789635309.599901:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1789635309.599922:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1789635309.599930:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789635309.599939:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1789635309.601999:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.602555:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410517888 00000100:00100000:0.0:1789635309.602565:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410517888 00000100:00100000:0.0:1789635309.602625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:0.0:1789635309.602635:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:11595:x1876568410517888:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789635309.602692:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635309.602725:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73a00/0x77332204cfbb3c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ce expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.602745:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:0.0:1789635309.602750:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635309.602778:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.602792:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.602802:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635309.603058:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ae8829e reply state 00000000be80b99b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.603067:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789635309.603167:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:11595:x1876568410517888:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 532us (1174us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789635309.603176:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:1.0:1789635309.610343:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635309.611036:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410518016 00000100:00100000:2.0:1789635309.611048:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410518016 00000100:00100000:2.0:1789635309.611118:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:2.0:1789635309.611128:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410518016:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789635309.611576:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789635309.611581:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789635310 -> 1789635309 00002000:00010000:2.0:1789635309.611583:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789635308 00002000:00010000:2.0:1789635309.611585:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789635310 -> 1789635309 00002000:00010000:2.0:1789635309.611587:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789635309.611656:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410518016:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 528us (1320us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789635309.611663:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:2.0:1789635309.614098:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1789635309.618622:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.618671:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.618680:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.618686:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635309.618692:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.618708:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.618724:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:0.0:1789635309.618728:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635309.618732:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.618738:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635309.618985:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410518272 00000100:00100000:3.0:1789635309.618997:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410518272 00000100:00100000:2.0:1789635309.619138:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:2.0:1789635309.619148:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+20:11595:x1876568410518272:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789635309.619209:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.619223:0:7562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.619233:0:7562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.619265:0:7562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.619279:0:7562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 20 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635309.619294:0:7562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7562:1876568422028800:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635309.619767:0:7562:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f90dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635309.625180:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.625253:0:7562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7562:1876568422028800:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635309.625279:0:7562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635309.627380:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410518400 00000100:00100000:1.0:1789635309.628367:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410518400 00010000:00010000:1.0:1789635309.628429:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635309.628475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:1.0:1789635309.628483:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+21:2348:x1876568410518400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635309.628498:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635309.628505:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.628519:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.628539:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73000/0x77332204cfbb3c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c0 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.628572:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:1.0:1789635309.628578:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.628587:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.628596:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.628621:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635309.628682:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:2348:x1876568410518400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 198us (3510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635309.628689:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00010000:00010000:0.0:1789635309.630060:0:7562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630072:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630122:0:7562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630129:0:7562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630136:0:7562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630143:0:7562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635309.630147:0:7562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630155:0:7562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630169:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:0.0:1789635309.630172:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789635309.630176:0:7562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.630182:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb3c5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.630239:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410518272:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 11092us (16148us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789635309.630247:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:2.0:1789635309.632301:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635309.632480:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410518528 00000100:00100000:1.0:1789635309.632489:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410518528 00000100:00100000:1.0:1789635309.632536:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:1.0:1789635309.632545:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410518528:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789635309.632582:0:8106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.632598:0:8106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.632607:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789635309.632612:0:8106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789635309.632617:0:8106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.632668:0:8106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 8 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.632685:0:8106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 8 pid: 8106 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635309.632708:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422028928:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635309.632856:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635309.636254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635309.636283:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410518656 00000100:00100000:3.0:1789635309.636301:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410518656 00010000:00010000:3.0:1789635309.636354:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 9 pid: 8106 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635309.636384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:3.0:1789635309.636620:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79d00c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+9:2348:x1876568410518656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635309.636634:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635309.636896:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 9 pid: 8106 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.636911:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 9 pid: 8106 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.637003:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8106:1876568422028928:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635309.637026:0:8106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.637092:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13e3852/0x77332204cfbb3c4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3dc expref: 9 pid: 8106 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.637109:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635309.637113:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635309.637118:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.637127:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.637307:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635309.637495:0:8106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637505:0:8106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637529:0:8106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637537:0:8106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637545:0:8106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637553:0:8106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635309.637557:0:8106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637565:0:8106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637577:0:8106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.637598:0:8106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070648d44/0x77332204cfbb3c61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.642255:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410518528:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 9696us (9946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635309.642272:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:3.0:1789635309.642590:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79d00c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2348:x1876568410518656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6195us (6341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635309.642616:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:2.0:1789635309.651163:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.651269:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410518912 00000100:00100000:0.0:1789635309.651280:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410518912 00000100:00100000:0.0:1789635309.651367:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:0.0:1789635309.651377:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+19:11595:x1876568410518912:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789635309.651461:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.651479:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.651490:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.651912:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.651924:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.651932:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.651981:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 20 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.651996:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 20 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.652023:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422029056:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635309.652091:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa9180 going to sleep for 11 seconds 00010000:00010000:3.0:1789635309.657651:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635309.658721:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.659253:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422029056:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635309.659284:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635309.662989:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410519040 00000100:00100000:3.0:1789635309.663005:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410519040 00010000:00010000:3.0:1789635309.663054:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635309.663124:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:3.0:1789635309.663135:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+21:2349:x1876568410519040:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635309.663151:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635309.663158:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.663173:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.663195:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3c7 expref: 21 pid: 7562 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.663209:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:3.0:1789635309.663214:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.663223:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.663231:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.663268:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635309.663443:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.663452:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789635309.663631:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1789635309.663910:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789635309.663956:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1789635309.664045:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876568422029184:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789635309.664099:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635309.664145:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635309.664378:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e05ee327-d920-4885-acb2-a26d789e134c+23:2349:x1876568410519040:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1244us (5662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635309.664499:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:2.0:1789635309.664679:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422029184 00000100:00100000:2.0:1789635309.664685:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422029184 00000100:00100000:2.0:1789635309.664742:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789635309.664751:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876568422029184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789635309.664846:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876568422029184:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635309.664853:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635309.665072:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789635309.665079:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79c8a53b80, transno 4294967319 00000004:00080000:3.0:1789635309.665099:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79e7b66a00, transno 4294967322 00000100:00100000:3.0:1789635309.665115:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876568422029184:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789635309.665851:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789635309.665929:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876568422029312:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789635309.665963:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635309.666003:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbf31780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635309.666185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422029312 00000100:00100000:3.0:1789635309.666190:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422029312 00000100:00100000:3.0:1789635309.666225:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789635309.666233:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876568422029312:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789635309.666416:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876568422029312:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (451us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789635309.666424:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789635309.666456:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876568422029312:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789635309.666483:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666492:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666501:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666508:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635309.666512:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666526:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666542:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79cdb4b200) 00010000:00010000:3.0:1789635309.666545:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635309.666550:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666556:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030800/0x77332204cfbb3c6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666581:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666587:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666592:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666597:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635309.666600:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666604:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666610:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635309.666612:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635309.666618:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666790:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666801:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.666825:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635309.666837:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422029440:192.168.201.30@tcp:105: 00000100:00100000:3.0:1789635309.666882:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8145c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635309.677715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635309.677871:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876568422029440:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789635309.677912:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.677923:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174e00/0x77332204cfbb3bb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.677959:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.677974:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.677985:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.677996:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678014:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678020:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678026:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635309.678031:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678039:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678052:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635309.678056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635309.678060:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678065:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678076:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678083:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678089:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678094:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635309.678118:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678127:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678136:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635309.678139:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635309.678141:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.678148:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0030c00/0x77332204cfbb3c68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635309.678435:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:11595:x1876568410518912:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 27057us (27280us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789635309.678446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 228 00000020:00080000:3.0:1789635309.678452:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789635309.678989:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410519168 00000100:00100000:0.0:1789635309.678998:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410519168 00000100:00100000:0.0:1789635309.679049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1789635309.679057:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:11594:x1876568410519168:12345-192.168.201.30@tcp:49:lfs.0 00000100:00100000:0.0:1789635309.679168:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:11594:x1876568410519168:12345-192.168.201.30@tcp:49:lfs.0 Request processed in 112us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635309.679176:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000040:00080000:1.0:1789635309.680480:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635309.680488:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635309.682766:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789635309.682782:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789635309.687519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635309.687564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635309.687947:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410519424 00000100:00100000:2.0:1789635309.687957:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410519424 00000100:00100000:2.0:1789635309.688020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:2.0:1789635309.688031:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+23:11594:x1876568410519424:12345-192.168.201.30@tcp:58:lfs.0 00000040:00080000:2.0:1789635309.688418:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789635309.688492:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+23:11594:x1876568410519424:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 463us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635309.688499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:0.0:1789635309.692913:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410519680 00000100:00100000:0.0:1789635309.692930:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410519680 00000100:00100000:1.0:1789635309.693066:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:1.0:1789635309.693075:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+23:11595:x1876568410519680:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789635309.694015:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789635309.694236:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789635309.694283:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.694306:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.694340:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.694351:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.694357:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.694364:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635309.694432:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789635309.694580:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+25:11595:x1876568410519680:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1503us (7012us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789635309.694587:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000020:00080000:1.0:1789635309.694593:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789635309.703427:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635309.703442:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.703454:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635309.703459:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.703470:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.703488:0:7642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e79d898a100) 00010000:00010000:2.0:1789635309.703491:0:7642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789635309.703496:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.703502:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84600/0x77332204cfbb3c7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.703546:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635309.703548:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635309.703549:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635309.732412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635309.732534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410519808 00000100:00100000:3.0:1789635309.732543:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410519808 00000100:00100000:3.0:1789635309.732598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:3.0:1789635309.732608:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+25:11597:x1876568410519808:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635309.732631:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635309.732650:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3e3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.732795:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.732809:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.732831:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.732844:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.732851:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.732856:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.733178:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.733189:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635309.733197:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.736942:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.736970:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 26 pid: 5843 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635309.738958:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe73f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422029568:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635309.739110:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8145c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635309.741986:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635309.742461:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe73f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876568422029568:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635309.742487:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635309.742637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520064 00000100:00100000:1.0:1789635309.742646:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520064 00000100:00100000:1.0:1789635309.742709:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1789635309.742719:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+27:5581:x1876568410520064:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789635309.742961:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+28:5581:x1876568410520064:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 242us (983us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789635309.742968:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1789635309.745176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635309.745258:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520192 00000100:00100000:0.0:1789635309.745266:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520192 00010000:00010000:0.0:1789635309.745298:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 28 pid: 5843 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635309.745365:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:0.0:1789635309.745375:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+28:2349:x1876568410520192:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789635309.745387:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635309.745393:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 28 pid: 5843 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.745406:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 28 pid: 5843 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.745427:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73200/0x77332204cfbb3ba4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3a4 expref: 28 pid: 5843 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.745442:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:0.0:1789635309.745448:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.745457:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.745475:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635309.745505:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789635309.745544:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e05ee327-d920-4885-acb2-a26d789e134c+27:2349:x1876568410520192:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 170us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635309.745551:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00010000:00010000:2.0:1789635309.745647:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745656:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635309.745703:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789635309.745707:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635309.745725:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745744:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745759:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745766:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745773:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745779:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635309.745783:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745790:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745800:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:2.0:1789635309.745803:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635309.745806:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745812:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3c8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745822:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745828:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745833:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745843:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635309.745845:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745851:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745859:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e79cdb4b200) 00010000:00010000:2.0:1789635309.745861:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635309.745863:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745869:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3c92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745909:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3c84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3e3 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745922:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3e3 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635309.745929:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:2.0:1789635309.745932:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789635309.745934:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72000, rc 0) 00000100:00100000:2.0:1789635309.745958:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+26:11597:x1876568410519808:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 13352us (13556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635309.745965:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 230 00000040:00080000:1.0:1789635310.570117:0:12628:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635310.570131:0:12628:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635310.570187:0:12628:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789635310.570195:0:12628:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789635310.681445:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635310.711583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635310.711627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635310.711663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635310.711695:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635310.711716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635310.711749:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520832 00000100:00100000:0.0:1789635310.711761:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520832 00000100:00100000:0.0:1789635310.711823:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520448 00000100:00100000:0.0:1789635310.711826:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520448 00000100:00100000:0.0:1789635310.711862:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:0.0:1789635310.711883:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410520832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635310.711974:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410520832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635310.711982:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:0.0:1789635310.712000:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:0.0:1789635310.712006:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:2351:x1876568410520448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635310.712034:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:2351:x1876568410520448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635310.712052:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:0.0:1789635310.712073:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520576 00000100:00100000:0.0:1789635310.712077:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520576 00000100:00100000:0.0:1789635310.712102:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520704 00000100:00100000:0.0:1789635310.712105:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520704 00000100:00100000:0.0:1789635310.712122:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:0.0:1789635310.712128:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410520576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635310.712166:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410520576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635310.712172:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:0.0:1789635310.712183:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:0.0:1789635310.712189:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410520704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635310.712211:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410520704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635310.712217:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00080000:0.0:1789635310.712231:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635310.712235:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635310.712238:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635310.713931:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520320 00000100:00100000:1.0:1789635310.713947:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520320 00000100:00100000:1.0:1789635310.714008:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00100000:1.0:1789635310.714016:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410520320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635310.714072:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410520320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 58us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635310.714079:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 282 00000040:00080000:0.0:1789635310.741538:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789635310.741549:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635310.741612:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789635310.741623:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789635310.741802:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422029696:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635310.742087:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e4aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635310.776706:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635310.776746:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410520960 00000100:00100000:0.0:1789635310.776766:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410520960 00000100:00100000:3.0:1789635310.776784:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1876568422029696:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789635310.776836:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:0.0:1789635310.776861:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:11609:x1876568410520960:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789635310.776908:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789635310.777031:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+26:11609:x1876568410520960:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 174us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635310.777040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:3.0:1789635310.788346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635310.795334:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410521216 00000100:00100000:1.0:1789635310.795358:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410521216 00000100:00100000:1.0:1789635310.795444:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:1.0:1789635310.795456:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+26:11609:x1876568410521216:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635310.795480:0:7562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635310.795506:0:7562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3ca0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3ea expref: -99 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635310.795631:0:7562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3ca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635310.795649:0:7562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635310.795662:0:7562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635310.795675:0:7562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789635310.795861:0:7562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb3ca0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ea expref: 29 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635310.795891:0:7562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ea expref: 28 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635310.795901:0:7562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635310.795904:0:7562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789635310.795909:0:7562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635310.795999:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e05ee327-d920-4885-acb2-a26d789e134c+28:11609:x1876568410521216:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 544us (7697us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789635310.796007:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:3.0:1789635310.809204:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635310.809700:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410521472 00000100:00100000:2.0:1789635310.809719:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410521472 00000100:00100000:2.0:1789635310.809793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:2.0:1789635310.809806:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+28:11609:x1876568410521472:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789635310.809929:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.809952:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.809965:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.810233:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.810243:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.810251:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.810259:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635310.810264:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.810273:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.810287:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:2.0:1789635310.810290:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789635310.810296:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635310.810343:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb3cb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635310.810853:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+29:11609:x1876568410521472:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 1047us (1659us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789635310.810863:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 233 00000040:00080000:2.0:1789635310.811281:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635310.811287:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635310.814013:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789635310.814034:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635310.818500:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635310.818970:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410521728 00000100:00100000:3.0:1789635310.818985:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410521728 00000100:00100000:3.0:1789635310.819143:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1789635310.819158:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+29:11609:x1876568410521728:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789635310.850411:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635310.850488:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410521856 00000100:00100000:1.0:1789635310.850500:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410521856 00000100:00100000:1.0:1789635310.850579:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789635310.850591:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+31:2348:x1876568410521856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635310.850606:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635310.850633:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb3ca7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ea expref: 31 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635310.850654:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:1.0:1789635310.850659:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635310.850727:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e05ee327-d920-4885-acb2-a26d789e134c+30:2348:x1876568410521856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635310.850732:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+30:11609:x1876568410521728:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 31574us (32243us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789635310.850740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:3.0:1789635310.850749:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:1.0:1789635310.890593:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422029824:0@lo:400:kworker.0 00000100:00100000:1.0:1789635310.890692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635310.890765:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422030080:0@lo:400:kworker.0 00000100:00100000:1.0:1789635310.890773:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422030336:0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.890812:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635310.890817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635310.890843:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422030592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635310.890854:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635310.890875:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422030208:0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.890882:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635310.890907:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789635310.890912:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635310.890917:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422029952:0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.890948:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635310.890957:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422029824 00000100:00100000:1.0:1789635310.890966:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422029824 00000100:00100000:3.0:1789635310.890970:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422030464:0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.890996:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635310.891028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789635310.891041:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422029824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635310.891110:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422029824:12345-0@lo:400:kworker.0 Request processed in 70us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635310.891118:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789635310.891136:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030080 00000100:00100000:3.0:1789635310.891141:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030080 00000100:00100000:3.0:1789635310.891180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422029952 00000100:00100000:3.0:1789635310.891183:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422029952 00000100:00100000:1.0:1789635310.891185:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422029824:0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.891194:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030464 00000100:00100000:3.0:1789635310.891197:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030464 00000100:00100000:3.0:1789635310.891214:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789635310.891222:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422030080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.891282:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422030080:12345-0@lo:400:kworker.0 Request processed in 62us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635310.891289:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789635310.891300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789635310.891306:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422029952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.891367:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422029952:12345-0@lo:400:kworker.0 Request processed in 61us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635310.891373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789635310.891383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789635310.891388:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422030464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635310.891408:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422030464:12345-0@lo:400:kworker.0 Request processed in 20us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635310.891414:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789635310.891432:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030592 00000100:00100000:3.0:1789635310.891436:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030592 00000100:00100000:3.0:1789635310.891464:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789635310.891470:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422030592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635310.891489:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789635310.891518:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422030592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635310.891524:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789635310.891689:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789635310.891695:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635310.892745:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422029952:0@lo:400:kworker.0 00000100:00100000:1.0:1789635310.892765:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422030464:0@lo:400:kworker.0 00000100:00100000:1.0:1789635310.892779:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422030080:0@lo:400:kworker.0 00000100:00100000:1.0:1789635310.892805:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422030592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635310.903385:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030336 00000100:00100000:0.0:1789635310.903406:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030336 00000100:00100000:3.0:1789635310.904360:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030208 00000100:00100000:3.0:1789635310.904378:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030208 00000100:00100000:0.0:1789635310.907761:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789635310.907794:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876568422030336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635310.907966:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876568422030336:12345-0@lo:400:kworker.0 Request processed in 188us (17150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635310.907976:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789635310.908006:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789635310.908016:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876568422030208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635310.908055:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876568422030208:12345-0@lo:400:kworker.0 Request processed in 42us (17145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635310.908062:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789635310.924787:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422030208:0@lo:400:kworker.0 00000100:00100000:0.0:1789635310.924808:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dbcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422030336:0@lo:400:kworker.0 00000001:00080000:2.0:1789635311.063106:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1789635311.063126:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:3.0:1789635311.699671:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635312.736671:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635313.279184:0:12680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789635313.279193:0:12680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789635313.279254:0:12680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789635313.279260:0:12680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789635313.574706:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635313.574873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410522112 00000100:00100000:3.0:1789635313.574885:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410522112 00000100:00100000:3.0:1789635313.574972:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 234 00000100:00100000:3.0:1789635313.574983:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+29:11630:x1876568410522112:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635313.575007:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635313.575026:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3cbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.575116:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3cc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.575129:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.575143:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635313.575153:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789635313.575280:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3cbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3f1 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.575295:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3f1 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.575303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635313.575306:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789635313.575330:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73600, rc 0) 00000100:00080000:1.0:1789635313.575455:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635313.575488:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+31:11630:x1876568410522112:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 506us (790us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789635313.575496:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 234 00000100:00100000:1.0:1789635313.580145:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635313.580861:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410522240 00000100:00100000:3.0:1789635313.580887:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410522240 00000100:00100000:3.0:1789635313.580955:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 235 00000100:00100000:3.0:1789635313.580967:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+31:11630:x1876568410522240:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1789635313.581034:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581051:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581064:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581090:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581097:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581105:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581123:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635313.581128:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581135:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581146:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635313.581150:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635313.581154:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.581170:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72200/0x77332204cfbb3cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635313.581233:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e05ee327-d920-4885-acb2-a26d789e134c+31:11630:x1876568410522240:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 269us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.581241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 235 00010000:00010000:2.0:1789635313.747508:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635313.826225:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635313.826362:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410522368 00000100:00100000:3.0:1789635313.826372:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410522368 00000100:00100000:3.0:1789635313.826461:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1789635313.826473:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410522368:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1789635313.826492:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635313.826513:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069b86d1/0x77332204cfbb3cd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3f8 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635313.826538:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aabaaed, atime: 0x6aabaaec, ctime: 0x6aabaaed, blocks: 0xb 00010000:00010000:3.0:1789635313.826559:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=289s v=(0 0) 00010000:00010000:3.0:1789635313.826563:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635313.826573:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069b86d1/0x77332204cfbb3cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3f8 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.826590:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000069b86d1/0x77332204cfbb3cd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3f8 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635313.826604:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72200, rc 0) 00000100:00100000:3.0:1789635313.826662:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+8:2349:x1876568410522368:12345-192.168.201.30@tcp:101:cat.0 Request processed in 192us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635313.826685:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00080000:1.0:1789635313.826765:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635313.841576:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635313.841679:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410522496 00000100:00100000:1.0:1789635313.841690:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410522496 00002000:00100000:1.0:1789635313.841740:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9e79dba6df80 x1876568410522496/t0(0) o3->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:689/0 lens 488/0 e 0 to 0 dl 1789635324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789635313.841752:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79dba6df80 with x1876568410522496 ext(0->4095) 00002000:00010000:1.0:1789635313.841772:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79dba6df80 00000100:00100000:1.0:1789635313.841806:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789635313.841903:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410522496:12345-192.168.201.30@tcp:3:cat.0 00000100:00100000:1.0:1789635313.842175:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e05ee327-d920-4885-acb2-a26d789e134c+8:2348:x1876568410522496:12345-192.168.201.30@tcp:3:cat.0 Request processed in 276us (607us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789635313.842184:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00002000:00100000:1.0:1789635313.842191:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9e79dba6df80 x1876568410522496/t0(0) o3->e05ee327-d920-4885-acb2-a26d789e134c@192.168.201.30@tcp:689/0 lens 488/4536 e 0 to 0 dl 1789635324 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789635313.842200:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e79dba6df80 with x1876568410522496 ext(0->4095) 00002000:00010000:1.0:1789635313.842204:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e79dba6df80 00000100:00100000:0.0:1789635314.451843:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422030720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635314.451920:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635314.452376:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030720 00000100:00100000:2.0:1789635314.452386:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030720 00000100:00100000:2.0:1789635314.452445:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789635314.452456:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422030720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789635314.452490:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635314.452544:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422030720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635314.452551:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789635314.453173:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789635314.453189:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1789635314.453207:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79c8a52680, transno 4294967310 00000100:00100000:0.0:1789635314.453223:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422030720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789635314.453751:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789635314.533728:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789635314.533746:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1789635314.555118:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000001:00080000:0.0:1789635314.555145:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:0.0:1789635314.555161:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e79d844d240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789635314.555166:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79c83caf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e79ecc4a000 00000020:00080000:0.0:1789635314.555169:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e79c83ca200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e79e7b42400 00000001:00080000:0.0:1789635314.555186:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:0.0:1789635314.555194:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1789635314.555486:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789635314.555678:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789635314.771684:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635315.797767:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635315.827741:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635315.827787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635315.827810:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635315.827831:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635315.827855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635315.827885:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410523136 00000100:00100000:2.0:1789635315.827895:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410523136 00000100:00100000:2.0:1789635315.827947:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410522752 00000100:00100000:2.0:1789635315.827950:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410522752 00000100:00100000:2.0:1789635315.827970:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:2.0:1789635315.827979:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410523136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635315.828196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:3.0:1789635315.828208:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+18:2349:x1876568410522752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635315.828212:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410522624 00000100:00100000:1.0:1789635315.828232:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410522624 00000100:00100000:1.0:1789635315.828267:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 284 00000100:00100000:1.0:1789635315.828277:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410522624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635315.828291:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+18:2349:x1876568410522752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635315.828299:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:1.0:1789635315.828334:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410522624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.828342:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 284 00000100:00100000:1.0:1789635315.828379:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410522880 00000100:00100000:1.0:1789635315.828383:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410522880 00000100:00100000:1.0:1789635315.828412:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410523008 00000100:00100000:1.0:1789635315.828414:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410523008 00000100:00100000:1.0:1789635315.828438:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1789635315.828447:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410522880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635315.828481:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+5:2349:x1876568410522880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.828501:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1789635315.828516:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1789635315.828523:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410523008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635315.828546:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410523008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.828552:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00080000:1.0:1789635315.828567:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635315.828572:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635315.828574:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635315.829210:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410523136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1228us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635315.829219:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:1.0:1789635315.990332:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635315.990355:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422030848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635315.990422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635315.990485:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030848 00000100:00100000:1.0:1789635315.990492:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030848 00000100:00100000:1.0:1789635315.990546:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789635315.990556:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422030848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635315.990592:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635315.990637:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422030848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.990644:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789635315.990668:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635315.990676:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789635315.990683:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789635315.990712:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422030848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635315.993459:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422030976:0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.993486:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422031104:0@lo:400:kworker.0 00000100:00100000:0.0:1789635315.993521:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635315.993528:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635315.993563:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422031488:0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.993576:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422030976 00000100:00100000:0.0:1789635315.993582:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635315.993584:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422030976 00000100:00100000:1.0:1789635315.993631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789635315.993650:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422030976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.993702:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3308:x1876568422030976:12345-0@lo:400:kworker.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.993711:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789635315.993729:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422030976:0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.993750:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422031360:0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.993786:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635315.993809:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635315.993814:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422031360 00000100:00100000:1.0:1789635315.993816:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422031232:0@lo:400:kworker.0 00000100:00100000:0.0:1789635315.993819:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422031360 00000100:00100000:1.0:1789635315.993848:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635315.993851:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789635315.993858:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422031360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.993883:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422031104 00000100:00100000:1.0:1789635315.993888:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422031104 00000100:00100000:0.0:1789635315.993895:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422031360:12345-0@lo:400:kworker.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635315.993908:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789635315.993918:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422031488 00000100:00100000:1.0:1789635315.993922:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422031488 00000100:00080000:0.0:1789635315.993945:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635315.993948:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422031232 00000100:00100000:1.0:1789635315.993951:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422031232 00000100:00100000:1.0:1789635315.993969:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789635315.993975:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422031104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.994007:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422031104:12345-0@lo:400:kworker.0 Request processed in 32us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.994014:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789635315.994025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789635315.994030:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568422031488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.994057:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568422031488:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.994063:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789635315.994072:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789635315.994077:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422031232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.994106:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422031232:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635315.994112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789635315.994141:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422031104:0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.994160:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422031232:0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.994168:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422031360:0@lo:400:kworker.0 00000100:00100000:1.0:1789635315.994185:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422031488:0@lo:400:kworker.0 00000100:00080000:0.0:1789635315.994424:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789635316.824154:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635317.844561:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635317.971667:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789635317.971678:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635317.971951:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789635317.971959:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789635318.867494:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635319.574831:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422031616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635319.574897:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635319.574972:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422031616 00000100:00100000:1.0:1789635319.574980:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422031616 00000100:00100000:1.0:1789635319.575035:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789635319.575046:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422031616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635319.575078:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635319.575131:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422031616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635319.575137:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789635319.575156:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635319.575191:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c72a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422031616:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1789635319.758628:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789635319.758925:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789635319.758936:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789635319.892365:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635320.560630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635320.586938:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410523264 00000100:00100000:1.0:1789635320.586954:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410523264 00000100:00100000:1.0:1789635320.587809:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00100000:1.0:1789635320.587824:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c72a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:11274:x1876568410523264:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789635320.587965:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c72a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:11274:x1876568410523264:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 145us (27345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635320.587983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00080000:0.0:1789635320.591703:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635320.593227:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635320.593707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410523520 00000100:00100000:3.0:1789635320.593719:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410523520 00000100:00100000:3.0:1789635320.593790:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1789635320.593802:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+18:11274:x1876568410523520:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789635320.595138:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:11274:x1876568410523520:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1334us (1927us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789635320.595149:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:3.0:1789635320.915797:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635321.108787:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422031872:0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.108870:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635321.108950:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422032384:0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.108972:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635321.109000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789635321.109006:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422031744:0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.109030:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635321.109046:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422032256:0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.109065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635321.109085:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422032000:0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.109104:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635321.109116:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422032512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635321.109133:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635321.109145:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635321.109149:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422032128:0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.109165:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635321.109204:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422031872 00000100:00100000:1.0:1789635321.109211:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422031872 00000100:00100000:1.0:1789635321.109484:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032384 00000100:00100000:1.0:1789635321.109489:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032384 00000100:00100000:1.0:1789635321.109507:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032000 00000100:00100000:1.0:1789635321.109522:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032000 00000100:00100000:1.0:1789635321.109542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789635321.109550:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422031872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.109599:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422031872:12345-0@lo:400:kworker.0 Request processed in 49us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635321.109605:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789635321.109621:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789635321.109627:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422032384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.109648:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876568422032384:12345-0@lo:400:kworker.0 Request processed in 22us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635321.109653:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789635321.109662:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789635321.109667:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422032000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635321.109741:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032256 00000100:00100000:2.0:1789635321.109745:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032256 00000100:00100000:2.0:1789635321.109770:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032128 00000100:00100000:2.0:1789635321.109772:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032128 00000100:00100000:2.0:1789635321.109790:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789635321.109795:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422032256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635321.109892:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032512 00000100:00100000:0.0:1789635321.109896:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032512 00000100:00100000:0.0:1789635321.109922:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789635321.109928:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876568422032512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635321.109952:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635321.111187:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789635321.111201:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422032128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635321.111447:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876568422032256:12345-0@lo:400:kworker.0 Request processed in 1651us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.111464:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789635321.111527:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422032256:0@lo:400:kworker.0 00000100:00100000:2.0:1789635321.111540:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422031872:0@lo:400:kworker.0 00000100:00100000:2.0:1789635321.111550:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876568422032384:0@lo:400:kworker.0 00000100:00080000:2.0:1789635321.111594:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635321.111599:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635321.111602:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635321.111624:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422031744 00000100:00100000:2.0:1789635321.111628:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422031744 00000100:00100000:2.0:1789635321.111655:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789635321.111660:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422031744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635321.111707:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422031744:12345-0@lo:400:kworker.0 Request processed in 46us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.111713:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789635321.111747:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422031744:0@lo:400:kworker.0 00000100:00100000:0.0:1789635321.113705:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422032512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3772us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635321.113715:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789635321.113801:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422032512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635321.113905:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422032000:12345-0@lo:400:kworker.0 Request processed in 4229us (4791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635321.113915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789635321.114031:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422032000:0@lo:400:kworker.0 00000100:00100000:1.0:1789635321.143159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635321.143208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635321.143360:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410523776 00000100:00100000:2.0:1789635321.143370:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410523776 00000100:00100000:2.0:1789635321.143434:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:2.0:1789635321.143443:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410523776:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.143522:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2351:x1876568410523776:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.143544:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00080000:0.0:1789635321.143615:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635321.143831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635321.143851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635321.143870:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410523904 00000100:00100000:1.0:1789635321.143875:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410523904 00000100:00100000:1.0:1789635321.143904:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:1.0:1789635321.143911:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410523904:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635321.143943:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2351:x1876568410523904:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635321.143960:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00080000:1.0:1789635321.144001:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635321.144200:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410523648 00000100:00100000:2.0:1789635321.144204:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410523648 00000100:00100000:2.0:1789635321.144366:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 287 00000100:00100000:2.0:1789635321.144375:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410523648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635321.144406:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410523648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635321.144413:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 287 00000100:00100000:0.0:1789635321.144662:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410524032 00000100:00100000:0.0:1789635321.144666:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410524032 00000100:00080000:1.0:1789635321.144748:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635321.144782:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:0.0:1789635321.144790:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410524032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635321.144829:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2351:x1876568410524032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635321.144835:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:3.0:1789635321.145020:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422032128:12345-0@lo:400:kworker.0 Request processed in 33822us (35850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635321.145028:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789635321.145120:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422032128:0@lo:400:kworker.0 00010000:00010000:2.0:1789635321.941203:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635322.963415:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635323.987830:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635324.697950:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422032640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635324.698020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635324.698112:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032640 00000100:00100000:3.0:1789635324.698120:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032640 00000100:00100000:3.0:1789635324.698170:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789635324.698179:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422032640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635324.698209:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635324.698248:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422032640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635324.698254:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789635324.698298:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635324.698351:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422032640:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789635324.755278:0:12883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:55:23 (1789635323) 00000001:00080000:0.0:1789635324.765954:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:3.0:1789635325.012432:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635326.037498:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635326.227743:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635326.228087:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422032896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635326.228131:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422033024:0@lo:400:kworker.0 00000100:00100000:0.0:1789635326.228157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635326.228159:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635326.228204:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635326.228209:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422033152:0@lo:400:kworker.0 00000100:00100000:2.0:1789635326.228231:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635326.228234:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422032768:0@lo:400:kworker.0 00000100:00100000:2.0:1789635326.228257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033024 00000100:00100000:0.0:1789635326.228260:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635326.228264:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033024 00000100:00100000:0.0:1789635326.228278:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635326.228283:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422033280:0@lo:400:kworker.0 00000100:00100000:0.0:1789635326.228303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635326.228347:0:7560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032896 00000100:00100000:0.0:1789635326.228352:0:7560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032896 00000100:00100000:0.0:1789635326.228390:0:7560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789635326.228414:0:7560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422032896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789635326.228449:0:7560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635326.228492:0:7560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422032896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635326.228498:0:7560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789635326.228538:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422032896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635326.228726:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033152 00000100:00100000:1.0:1789635326.228730:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033152 00000100:00100000:1.0:1789635326.228757:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789635326.228765:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422033024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635326.228821:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422033024:12345-0@lo:400:kworker.0 Request processed in 57us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635326.228828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789635326.228841:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789635326.228848:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422033152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635326.228874:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422033152:12345-0@lo:400:kworker.0 Request processed in 28us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635326.228880:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1789635326.228896:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635326.228901:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635326.228920:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422033152:0@lo:400:kworker.0 00000100:00100000:1.0:1789635326.228931:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422033024:0@lo:400:kworker.0 00000100:00100000:2.0:1789635326.229682:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422032768 00000100:00100000:3.0:1789635326.229896:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635326.229911:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422033408:0@lo:400:kworker.0 00000100:00100000:3.0:1789635326.229952:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635326.230113:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422032768 00000100:00100000:2.0:1789635326.230153:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789635326.230161:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422032768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635326.230202:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422032768:12345-0@lo:400:kworker.0 Request processed in 42us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635326.230208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789635326.230236:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033408 00000100:00100000:2.0:1789635326.230245:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033408 00000100:00100000:2.0:1789635326.230272:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789635326.230278:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422033408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789635326.230410:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635326.232935:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033280 00000100:00100000:3.0:1789635326.232949:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033280 00000100:00100000:3.0:1789635326.233013:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789635326.233023:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422033280:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789635326.233086:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635326.233330:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422032768:0@lo:400:kworker.0 00000100:00100000:3.0:1789635326.233541:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422033280:12345-0@lo:400:kworker.0 Request processed in 519us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635326.233681:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789635326.233813:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422033408:12345-0@lo:400:kworker.0 Request processed in 3533us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635326.233822:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789635326.233921:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422033408:0@lo:400:kworker.0 00000100:00100000:0.0:1789635326.233974:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422033280:0@lo:400:kworker.0 00000100:00100000:2.0:1789635326.594877:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635326.594922:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635326.594955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635326.594977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635326.594998:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635326.595028:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410524160 00000100:00100000:2.0:1789635326.595039:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410524160 00000100:00100000:2.0:1789635326.595100:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:2.0:1789635326.595112:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410524160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635326.595198:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2349:x1876568410524160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635326.595205:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:2.0:1789635326.595241:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410524544 00000100:00100000:2.0:1789635326.595245:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410524544 00000100:00100000:3.0:1789635326.595382:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410524288 00000100:00100000:3.0:1789635326.595387:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410524288 00000100:00100000:3.0:1789635326.595431:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:3.0:1789635326.595437:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:2349:x1876568410524288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635326.595481:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e05ee327-d920-4885-acb2-a26d789e134c+18:2349:x1876568410524288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 45us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635326.595504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:3.0:1789635326.595517:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410524672 00000100:00100000:3.0:1789635326.595520:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410524672 00000100:00100000:3.0:1789635326.595541:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:3.0:1789635326.595546:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410524672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635326.595569:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:2349:x1876568410524672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635326.595574:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:2.0:1789635326.595779:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410524416 00000100:00100000:2.0:1789635326.595783:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410524416 00000100:00100000:0.0:1789635326.595958:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:0.0:1789635326.595970:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410524544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635326.596001:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e05ee327-d920-4885-acb2-a26d789e134c+7:2349:x1876568410524544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635326.596006:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:2.0:1789635326.596137:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:2.0:1789635326.596145:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+5:2347:x1876568410524416:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:2.0:1789635326.596168:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb36db 00000100:00080000:2.0:1789635326.596177:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79e73f4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789635326.596220:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789635326.596526:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e05ee327-d920-4885-acb2-a26d789e134c+2:2347:x1876568410524416:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 380us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635326.596533:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00010000:00010000:1.0:1789635326.602904:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635326.605239:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789635326.605254:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635326.605259:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789635327.061010:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635327.195990:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789635327.196002:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789635327.197686:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789635327.197702:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789635327.916422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635327.916572:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410524800 00000100:00100000:3.0:1789635327.916590:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410524800 00000100:00100000:3.0:1789635327.916663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 237 00000100:00100000:3.0:1789635327.916676:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+5:12294:x1876568410524800:12345-192.168.201.30@tcp:101:lsof.0 00010000:00010000:3.0:1789635327.916706:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635327.916734:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3cdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d3ff expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635327.916824:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3ce6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635327.916837:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635327.916847:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635327.916905:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635327.916998:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635327.917045:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635327.917069:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73800/0x77332204cfbb3cdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ff expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635327.917086:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ff expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635327.917092:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635327.917094:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635327.917097:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73c00, rc 0) 00000100:00100000:3.0:1789635327.917161:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:12294:x1876568410524800:12345-192.168.201.30@tcp:101:lsof.0 Request processed in 489us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635327.917166:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 237 00010000:00010000:3.0:1789635328.083872:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635329.112992:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635329.812731:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422033536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635329.812802:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635329.812929:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033536 00000100:00100000:3.0:1789635329.812938:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033536 00000100:00100000:3.0:1789635329.812992:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789635329.813002:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422033536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635329.813039:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635329.813086:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422033536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635329.813109:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789635329.813136:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635329.813182:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422033536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635330.100214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635330.100794:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410525056 00000100:00100000:0.0:1789635330.100808:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410525056 00000100:00100000:0.0:1789635330.100899:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1789635330.100912:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+18:12296:x1876568410525056:12345-192.168.201.30@tcp:35:umount.0 00000100:00080000:3.0:1789635330.101592:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635330.103659:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+19:12296:x1876568410525056:12345-192.168.201.30@tcp:35:umount.0 Request processed in 2738us (3447us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789635330.103673:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1789635330.116049:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635330.121948:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410525312 00000100:00100000:1.0:1789635330.121965:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410525312 00000100:00100000:1.0:1789635330.122023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1789635330.122033:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+19:12296:x1876568410525312:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:1.0:1789635330.122664:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e05ee327-d920-4885-acb2-a26d789e134c+20:12296:x1876568410525312:12345-192.168.201.30@tcp:35:umount.0 Request processed in 631us (6624us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789635330.122673:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:2.0:1789635330.125067:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635330.125498:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410525568 00000100:00100000:0.0:1789635330.125506:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410525568 00000100:00100000:0.0:1789635330.125554:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1789635330.125564:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c9d33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+20:12296:x1876568410525568:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:0.0:1789635330.125912:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c9d33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:12296:x1876568410525568:12345-192.168.201.30@tcp:35:umount.0 Request processed in 349us (849us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789635330.125921:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00010000:00010000:1.0:1789635330.131792:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635330.137685:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635330.138567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410525824 00000100:00100000:0.0:1789635330.138580:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410525824 00000100:00100000:0.0:1789635330.138675:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1789635330.138686:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:12296:x1876568410525824:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:0.0:1789635330.139030:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:12296:x1876568410525824:12345-192.168.201.30@tcp:35:umount.0 Request processed in 346us (1355us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789635330.139037:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1789635330.143267:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635330.143306:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635330.143378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635330.143412:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410526464 00000100:00100000:2.0:1789635330.143421:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410526464 00000100:00100000:2.0:1789635330.143479:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410526336 00000100:00100000:2.0:1789635330.143483:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410526336 00000100:00100000:2.0:1789635330.143498:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410526592 00000100:00100000:2.0:1789635330.143500:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410526592 00000100:00100000:2.0:1789635330.143516:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789635330.143537:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+15:2351:x1876568410526464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635330.143551:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635330.143572:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b84c00/0x77332204cfbb2cbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf59 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635330.143588:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635330.143636:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+14:2351:x1876568410526464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635330.143643:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789635330.143660:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1789635330.143666:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+13:2351:x1876568410526336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635330.143673:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635330.143694:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe820000/0x77332204cfbb2d03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf91 expref: 13 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635330.143703:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635330.143720:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+12:2351:x1876568410526336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 55us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635330.143726:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1789635330.143738:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1789635330.143744:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:2351:x1876568410526592:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635330.143751:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635330.143759:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0030000/0x77332204cfbb2f48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d05c expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635330.143767:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635330.143781:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2351:x1876568410526592:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 38us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635330.143787:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1789635330.145634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635330.145668:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410526208 00000100:00100000:2.0:1789635330.145674:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410526208 00000100:00100000:2.0:1789635330.145717:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:2.0:1789635330.145726:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+7:2347:x1876568410526208:12345-192.168.201.30@tcp:9:umount.0 00000020:00000080:2.0:1789635330.145763:0:8106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb32a5 00000020:00010000:2.0:1789635330.145771:0:8106:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e79d082f000: total 0 00000100:00080000:2.0:1789635330.145776:0:8106:0:(import.c:65:import_set_state_nolock()) ffff9e79d0828000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789635330.145811:0:8106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789635330.146056:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e05ee327-d920-4885-acb2-a26d789e134c+5:2347:x1876568410526208:12345-192.168.201.30@tcp:9:umount.0 Request processed in 331us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635330.146073:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000020:00010000:3.0:1789635330.146952:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e79d082f000: total 0 00010000:00010000:3.0:1789635330.146984:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e79d082f000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789635330.147032:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054353540/0x77332204cfbb3641 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d231 expref: 4 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.147067:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069b86d1/0x77332204cfbb3cd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3f8 expref: 3 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.147082:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e79d082f000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789635330.147092:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635330.147094:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635330.147096:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635330.147105:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635330.157584:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635330.157658:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410527616 00000100:00100000:0.0:1789635330.157669:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410527616 00000100:00100000:0.0:1789635330.157730:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:0.0:1789635330.157750:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+22:2347:x1876568410527616:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:0.0:1789635330.157784:0:5842:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2ccb 00000020:00010000:0.0:1789635330.157797:0:5842:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e79fdd1e800: total 0 00000100:00080000:0.0:1789635330.157801:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9e79dc0e1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635330.157826:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1789635330.158181:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e05ee327-d920-4885-acb2-a26d789e134c+21:2347:x1876568410527616:12345-192.168.201.30@tcp:39:umount.0 Request processed in 433us (607us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789635330.158189:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 238 00000020:00010000:3.0:1789635330.161675:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e79fdd1e800: total 0 00010000:00010000:3.0:1789635330.161730:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e79fdd1e800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789635330.162131:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635330.162136:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635330.162146:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72600/0x77332204cfbb3522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d1e4 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162176:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635330.162179:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635330.162197:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72000/0x77332204cfbb3c99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3e3 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162213:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635330.162227:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635330.162232:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02174600/0x77332204cfbb3013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d086 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162247:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635330.162250:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789635330.162254:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73600/0x77332204cfbb3cc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3f1 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162266:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d91ba700) 00010000:00010000:3.0:1789635330.162269:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635330.162273:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72400/0x77332204cfbb2fbf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d071 expref: 16 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162290:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:3.0:1789635330.162292:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635330.162296:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820e00/0x77332204cfbb3997 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d31f expref: 15 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162308:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635330.162354:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789635330.162359:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72e00/0x77332204cfbb362c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d22a expref: 14 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162372:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e79d088ec00) 00010000:00010000:3.0:1789635330.162380:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789635330.162384:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7a02175600/0x77332204cfbb3bb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ab expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162402:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e79d088eb00) 00010000:00010000:3.0:1789635330.162404:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635330.162408:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79c0031400/0x77332204cfbb36b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d24d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162424:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e79d91f3300) 00010000:00010000:3.0:1789635330.162427:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635330.162430:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb3602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d21c expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162445:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:3.0:1789635330.162448:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635330.162452:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c72800/0x77332204cfbb3695 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d246 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162463:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e79d898a000) 00010000:00010000:3.0:1789635330.162466:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789635330.162469:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73e00/0x77332204cfbb3300 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d158 expref: 9 pid: 7562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162483:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e79d91f3900) 00010000:00010000:3.0:1789635330.162485:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635330.162488:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820400/0x77332204cfbb2fa3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d06a expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635330.162513:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e79fdd1e800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789635330.162535:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635330.162537:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635330.162539:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635331.159742:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635331.347633:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635331.347659:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422033664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635331.347745:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635331.347777:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033664 00000100:00100000:2.0:1789635331.347786:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033664 00000100:00080000:3.0:1789635331.347919:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635331.347960:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422033792:0@lo:400:kworker.0 00000100:00100000:1.0:1789635331.347993:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635331.348016:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422034304:0@lo:400:kworker.0 00000100:00100000:1.0:1789635331.348038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635331.348055:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635331.348060:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422033920:0@lo:400:kworker.0 00000100:00100000:1.0:1789635331.348078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635331.348100:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422034176:0@lo:400:kworker.0 00000100:00100000:1.0:1789635331.348135:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635331.348153:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635331.348158:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422034048:0@lo:400:kworker.0 00000100:00100000:3.0:1789635331.348170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034304 00000100:00100000:3.0:1789635331.348174:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034304 00000100:00100000:1.0:1789635331.348176:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635331.348200:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033792 00000100:00100000:1.0:1789635331.348203:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033792 00000100:00100000:3.0:1789635331.348216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422033920 00000100:00100000:3.0:1789635331.348219:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422033920 00000100:00100000:1.0:1789635331.348227:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789635331.348230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034048 00000100:00100000:3.0:1789635331.348232:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034048 00000100:00100000:1.0:1789635331.348235:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422033792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635331.348243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789635331.348249:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422034304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635331.348281:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3306:x1876568422033792:12345-0@lo:400:kworker.0 Request processed in 46us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635331.348288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789635331.348296:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789635331.348302:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422033664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635331.348334:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034176 00000100:00100000:1.0:1789635331.348338:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034176 00000100:00100000:1.0:1789635331.348363:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789635331.348369:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422034176:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789635331.348377:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635331.348401:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422034176:12345-0@lo:400:kworker.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635331.348405:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422033664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635331.348407:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789635331.348411:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789635331.348423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789635331.348429:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422033920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635331.348979:0:5843:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789635331.348990:0:5843:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789635331.349155:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422033664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635331.350936:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789635331.350955:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422034048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635331.351033:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422034048:12345-0@lo:400:kworker.0 Request processed in 85us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635331.351040:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789635331.359285:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422033920:0@lo:400:kworker.0 00000100:00100000:0.0:1789635331.359378:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422033792:0@lo:400:kworker.0 00000100:00100000:0.0:1789635331.359394:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422034304:0@lo:400:kworker.0 00000100:00100000:0.0:1789635331.359705:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422034048:0@lo:400:kworker.0 00000100:00100000:0.0:1789635331.359719:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422034176:0@lo:400:kworker.0 00000100:00080000:0.0:1789635331.359764:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789635331.359772:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635331.366973:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422034304:12345-0@lo:400:kworker.0 Request processed in 18712us (18922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635331.366990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789635331.369169:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422033920:12345-0@lo:400:kworker.0 Request processed in 20732us (21082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635331.369184:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000001:00100000:3.0:1789635331.426559:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:3.0:1789635331.426569:0:6717:0:(genops.c:885:class_export_put()) final put ffff9e79e73f1000/e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:1.0:1789635331.428533:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79e73f1000/e05ee327-d920-4885-acb2-a26d789e134c for lustre-OST0000 00000020:00000080:1.0:1789635331.428592:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79e73f4800 for lustre-OST0000 00000100:00100000:2.0:1789635331.695702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635331.695764:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635331.695864:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410527872 00000100:00100000:3.0:1789635331.695875:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410527872 00000100:00100000:3.0:1789635331.695969:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:3.0:1789635331.695985:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:2351:x1876568410527872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635331.696070:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:2351:x1876568410527872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635331.696078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00080000:1.0:1789635331.696151:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635331.696461:0:7647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410527744 00000100:00100000:0.0:1789635331.696466:0:7647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410527744 00000100:00100000:0.0:1789635331.696513:0:7647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 291 00000100:00100000:0.0:1789635331.696522:0:7647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2351:x1876568410527744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635331.696578:0:7647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2351:x1876568410527744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 56us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635331.696585:0:7647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 291 00000100:00100000:2.0:1789635332.118433:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635332.118482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635332.118567:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410528000 00000100:00100000:1.0:1789635332.118578:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410528000 00000100:00100000:1.0:1789635332.118638:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410528128 00000100:00100000:1.0:1789635332.118641:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410528128 00000100:00100000:1.0:1789635332.118679:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789635332.118689:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79d00c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+11:2348:x1876568410528000:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635332.118705:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635332.118725:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85600/0x77332204cfbb2dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfa6 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635332.118743:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635332.118795:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79d00c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+10:2348:x1876568410528000:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 108us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635332.118801:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789635332.118856:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1789635332.118863:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+9:2349:x1876568410528128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635332.118870:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635332.118879:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1677200/0x77332204cfbb2db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cfd0 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635332.118888:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635332.118904:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:2349:x1876568410528128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635332.118910:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1789635332.122665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635332.122833:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410528256 00000100:00100000:1.0:1789635332.122845:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410528256 00000100:00100000:1.0:1789635332.122912:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789635332.122923:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+8:2350:x1876568410528256:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635332.122952:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635332.123687:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79e7c73400/0x77332204cfbb2f41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d055 expref: 8 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635332.123709:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635332.123781:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+7:2350:x1876568410528256:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 859us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635332.123800:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789635332.135482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635332.135658:0:7562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410528512 00000100:00100000:0.0:1789635332.135670:0:7562:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410528512 00000100:00100000:0.0:1789635332.135734:0:7562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:0.0:1789635332.135746:0:7562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+6:2347:x1876568410528512:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:0.0:1789635332.135795:0:7562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2dc0 00000020:00010000:0.0:1789635332.135805:0:7562:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e79c7344000: total 0 00000100:00080000:0.0:1789635332.135810:0:7562:0:(import.c:65:import_set_state_nolock()) ffff9e79c7343000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635332.135840:0:7562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1789635332.136156:0:7641:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e79c7344000: total 0 00010000:00010000:1.0:1789635332.136203:0:7641:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e79c7344000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789635332.136252:0:7641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91bab00) 00010000:00010000:1.0:1789635332.136256:0:7641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635332.136264:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79e7c73c00/0x77332204cfbb3ce6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d3ff expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635332.136288:0:7641:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e79c7344000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789635332.136298:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635332.136300:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635332.136302:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635332.136413:0:7562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83+3:2347:x1876568410528512:12345-192.168.201.30@tcp:39:umount.0 Request processed in 668us (940us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789635332.136421:0:7562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:3.0:1789635332.163542:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635332.163786:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410528768 00000100:00100000:1.0:1789635332.163796:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410528768 00000100:00100000:1.0:1789635332.163879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 292 00000100:00100000:1.0:1789635332.163887:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+7:2347:x1876568410528768:12345-192.168.201.30@tcp:251:umount.0 00000020:00000080:1.0:1789635332.163927:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2ca8 00000020:00010000:1.0:1789635332.163933:0:5835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e79fdd18800: total 0 00000100:00080000:1.0:1789635332.163937:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9e79fdd1a800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789635332.164005:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee2f9f50-e99a-486f-bfef-c674f5dea4b8+3:2347:x1876568410528768:12345-192.168.201.30@tcp:251:umount.0 Request processed in 119us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635332.164020:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 292 00000020:00010000:3.0:1789635332.164407:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e79fdd18800: total 0 00010000:00010000:3.0:1789635332.164412:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635332.164450:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e79fdd18800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789635332.164594:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821200/0x77332204cfbb2d0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632cf98 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635332.164613:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e79fdd18800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789635332.164623:0:5830:0:(genops.c:885:class_export_put()) final put ffff9e79fdd18800/ee2f9f50-e99a-486f-bfef-c674f5dea4b8 00010000:00010000:3.0:1789635332.164641:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635332.164643:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635332.164645:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789635332.164816:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fdd18800/ee2f9f50-e99a-486f-bfef-c674f5dea4b8 for MGS 00000020:00000080:2.0:1789635332.164863:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fdd1a800 for MGS 00010000:00010000:3.0:1789635332.179686:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635333.205232:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789635333.665990:0:13082:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789635333.677551:0:13082:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789635333.677600:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.677614:0:13082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.677620:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.677627:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.677655:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789635333.677660:0:13082:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789635333.677693:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789635333.677786:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635333.677793:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.677801:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85000 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:2.0:1789635333.677804:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.677814:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789635333.677835:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635333.677841:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789635333.677844:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789635333.677846:0:7641:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789635333.677894:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.677901:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635333.677927:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.677934:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85000/0x77332204cfbb2d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.677946:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635333.677948:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635333.677950:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635333.677967:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422034432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635333.678032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.678098:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034432 00000100:00100000:2.0:1789635333.678105:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034432 00000100:00100000:2.0:1789635333.678151:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789635333.678161:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3307:x1876568422034432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635333.678173:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635333.678188:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821400/0x77332204cfbb2d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2d49 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.678210:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635333.678246:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3307:x1876568422034432:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.678253:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789635333.678291:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422034432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635333.678434:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789635333.678442:0:13082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789635333.678465:0:13082:0:(import.c:65:import_set_state_nolock()) ffff9e79fedbd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789635333.678651:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568422034560:0@lo:39:umount.0 00000100:00100000:2.0:1789635333.678695:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635333.678865:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034560 00000100:00100000:1.0:1789635333.678871:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034560 00000100:00100000:1.0:1789635333.678911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789635333.678919:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876568422034560:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789635333.678943:0:5842:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2ad3 00000100:00080000:1.0:1789635333.678951:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9e79c8b0c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789635333.682863:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1876568422034560:12345-0@lo:39:umount.0 Request processed in 3936us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635333.682890:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000020:00000080:1.0:1789635333.682905:0:5842:0:(genops.c:885:class_export_put()) final put ffff9e79c8b0d000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789635333.684445:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789635333.684470:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8b0d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789635333.684547:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79c8b0c000 for lustre-MDT0000 00000100:00080000:2.0:1789635333.685207:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fedbd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789635333.685229:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568422034560:0@lo:39:umount.0 00000100:00080000:3.0:1789635333.686496:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635333.686503:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789635333.686509:0:13082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789635333.689845:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.689865:0:13082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.689873:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.689881:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.689960:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635333.689967:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.689974:0:13082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.689981:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.689988:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692683:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635333.692704:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692716:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84a00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635333.692720:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692730:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635333.692737:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635333.692742:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789635333.692744:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789635333.692788:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692794:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635333.692829:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692836:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84a00/0x77332204cfbb2d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692851:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635333.692855:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692874:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635333.692877:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692883:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635333.692888:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635333.692893:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789635333.692895:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1789635333.692907:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692913:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635333.692918:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.692925:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635333.692926:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635333.692928:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635333.692976:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422034816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635333.693043:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.693098:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635333.693104:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c8a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422034688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635333.693124:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.693153:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034816 00000100:00100000:2.0:1789635333.693160:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034816 00000100:00100000:2.0:1789635333.693197:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034688 00000100:00100000:2.0:1789635333.693200:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034688 00000100:00100000:2.0:1789635333.693218:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635333.693225:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+19:3309:x1876568422034816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635333.693237:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635333.693250:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb2cf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2cee expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.693277:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635333.693348:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+18:3309:x1876568422034816:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.693355:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635333.693371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635333.693377:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:3309:x1876568422034688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635333.693384:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635333.693392:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676a00/0x77332204cfbb2d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2d57 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.693399:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635333.693419:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3309:x1876568422034688:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.693425:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789635333.693470:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c8a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422034688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635333.693480:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ec8828bc-aabc-4548-96aa-655e15bcddbb:3309:1876568422034816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635333.695721:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635333.695735:0:13082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb2cee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2cf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635333.695754:0:13082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789635333.695766:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.695774:0:13082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.695781:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.695787:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.695879:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635333.695886:0:13082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.695893:0:13082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.695899:0:13082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635333.695904:0:13082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696002:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635333.696010:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696017:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02174200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635333.696020:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696038:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635333.696045:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635333.696051:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789635333.696053:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789635333.696055:0:7641:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789635333.696083:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696089:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789635333.696134:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422034944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635333.696188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789635333.696249:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696256:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02174200/0x77332204cfbb2f6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2f72 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696276:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635333.696280:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696285:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635333.696288:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696294:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635333.696327:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635333.696333:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789635333.696335:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1789635333.696348:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.696354:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789635333.696412:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635333.696423:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422035072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635333.696449:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.696494:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422034944 00000100:00100000:2.0:1789635333.696500:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422034944 00000100:00100000:2.0:1789635333.696531:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422035072 00000100:00100000:2.0:1789635333.696534:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422035072 00000100:00100000:2.0:1789635333.696550:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635333.696557:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+17:3306:x1876568422034944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635333.696567:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635333.696578:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175a00/0x77332204cfbb2f72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2f6b expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.696597:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635333.701881:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635333.701906:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635333.701909:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635333.701911:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635333.703820:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+16:3306:x1876568422034944:12345-0@lo:103:ldlm_bl.0 Request processed in 7254us (7623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.703834:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789635333.703871:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635333.703888:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79d00c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+15:3307:x1876568422035072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635333.703907:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635333.703928:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676c00/0x77332204cfbb2a39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2a32 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635333.703947:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635333.704015:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79d00c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec8828bc-aabc-4548-96aa-655e15bcddbb+14:3307:x1876568422035072:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (7565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635333.704021:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789635333.704152:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422035072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635333.704236:0:13082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635333.704244:0:13082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c0031200/0x77332204cfbb2a32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2a39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635333.704260:0:13082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1789635333.704265:0:13082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789635333.704267:0:13082:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789635333.704302:0:13082:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789635333.704306:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789635333.704341:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635333.704347:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1789635333.704352:0:13082:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9e79dc2fd000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789635333.704363:0:13082:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9e79e4a6c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789635333.704369:0:13082:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9e79c7344000 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 192.168.201.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789635333.704374:0:13082:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9e79fdd1e800 e05ee327-d920-4885-acb2-a26d789e134c 192.168.201.30@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:3.0:1789635333.704391:0:13082:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9e79feda3380) has exports, disconnecting them 00000020:00080000:3.0:1789635333.704396:0:13082:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e79dc2fd000), last request at 1789635331 00000020:00000080:3.0:1789635333.704403:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2c93 00000100:00080000:3.0:1789635333.704418:0:13082:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2f8800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789635333.704474:0:13082:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e79dc2fd000): rc 0 00000020:00000080:3.0:1789635333.704477:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79dc2fd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789635333.704486:0:13082:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e79e4a6c000), last request at 1789635331 00000020:00000080:3.0:1789635333.704489:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2b7b 00000100:00080000:3.0:1789635333.704494:0:13082:0:(import.c:65:import_set_state_nolock()) ffff9e79e4a6d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789635333.704503:0:13082:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e79e4a6c000): rc 0 00000020:00000080:3.0:1789635333.704504:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79e4a6c000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789635333.704510:0:13082:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc31402f0bae0 00000100:00080000:3.0:1789635333.704528:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789635333.704532:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789635333.704542:0:13082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789635333.704608:0:13082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789635333.704626:0:13082:0:(import.c:65:import_set_state_nolock()) ffff9e79fe382800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789635333.704639:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789635333.704641:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1789635333.704647:0:13082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1789635333.704810:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79dc2fd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789635333.704849:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79e4a6c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789635333.704873:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79dc2f8800 for lustre-MDT0000 00000020:00000080:1.0:1789635333.704878:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79e4a6d000 for lustre-MDT0000 00010000:00010000:1.0:1789635333.704893:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635333.704949:0:13082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789635333.704960:0:13082:0:(import.c:65:import_set_state_nolock()) ffff9e79fe707800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789635333.706610:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635333.706635:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422035200:0@lo:9:umount.0 00000100:00100000:2.0:1789635333.706839:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635333.706905:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422035328:0@lo:9:umount.0 00000100:00100000:2.0:1789635333.706927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635333.707139:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ec8828bc-aabc-4548-96aa-655e15bcddbb:3306:1876568422034944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635333.707247:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635333.707308:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422035200 00000100:00100000:1.0:1789635333.707340:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422035200 00000100:00100000:1.0:1789635333.707396:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422035328 00000100:00100000:1.0:1789635333.707400:0:8106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422035328 00000100:00100000:1.0:1789635333.707422:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789635333.707431:0:8106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876568422035200:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789635333.707468:0:8106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2bc8 00000100:00080000:1.0:1789635333.707492:0:8106:0:(import.c:65:import_set_state_nolock()) ffff9e79e7879000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789635333.707531:0:8106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1789635333.707822:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635333.707827:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635333.707843:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789635333.707852:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876568422035328:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789635333.707866:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2ca1 00000100:00080000:0.0:1789635333.707873:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e79dc0e7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789635333.707901:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789635333.708045:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1876568422035328:12345-0@lo:9:umount.0 Request processed in 195us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635333.708059:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1789635333.708080:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635333.708281:0:8106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1876568422035200:12345-0@lo:9:umount.0 Request processed in 850us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635333.708288:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:1.0:1789635333.708306:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789635333.708477:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9e79feda3380) has no exports 00000100:00080000:2.0:1789635333.708621:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fe382800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789635333.708644:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789635333.708647:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789635333.708651:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422035200:0@lo:9:umount.0 00000100:00080000:2.0:1789635333.708663:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fe707800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789635333.708684:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789635333.708694:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789635333.708706:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422035328:0@lo:9:umount.0 00000020:00080000:1.0:1789635333.720907:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9e79feda3380) has no exports 00000020:00000080:1.0:1789635333.789510:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a8d 00000020:00000080:1.0:1789635333.789526:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79c9d6b800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789635333.789574:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789635333.789647:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635333.789657:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789635333.789661:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9e79c619b380) has no exports 00000020:00000080:0.0:1789635333.790179:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a86 00000020:00000080:0.0:1789635333.790185:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79e4a6b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789635333.790210:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c9d6b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789635333.792756:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79e4a6b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635333.797761:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635333.797776:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789635333.797781:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79e4a6c800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789635333.797785:0:13082:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79e4a6c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789635333.797795:0:13082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1789635334.228618:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789635335.021502:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00000001:00080000:2.0:1789635335.021523:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789635335.021529:0:5865:0:(genops.c:885:class_export_put()) final put ffff9e79c7344000/2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 00000001:00100000:2.0:1789635335.021550:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000001:00080000:2.0:1789635335.021556:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789635335.021569:0:5865:0:(genops.c:885:class_export_put()) final put ffff9e79fdd1e800/e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:2.0:1789635335.021586:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c7344000/2a2e3b26-e8a4-48d2-acb7-3d1f0475eb83 for lustre-MDT0000 00000020:00000080:2.0:1789635335.021640:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fdd1e800/e05ee327-d920-4885-acb2-a26d789e134c for lustre-MDT0000 00000020:00000080:2.0:1789635335.021673:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79c7343000 for lustre-MDT0000 00000020:00000080:2.0:1789635335.021679:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79dc0e1000 for lustre-MDT0000 00000001:00100000:0.0:1789635335.044145:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789635335.044156:0:7663:0:(genops.c:885:class_export_put()) final put ffff9e79dc0e7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789635335.044178:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:0.0:1789635335.044181:0:7663:0:(genops.c:885:class_export_put()) final put ffff9e79d082f000/e05ee327-d920-4885-acb2-a26d789e134c 00000020:00000080:1.0:1789635335.044268:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79dc0e7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789635335.044351:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79d082f000/e05ee327-d920-4885-acb2-a26d789e134c for lustre-OST0001 00000020:00000080:1.0:1789635335.044375:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79dc0e7000 for lustre-OST0001 00000020:00000080:1.0:1789635335.044380:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79d0828000 for lustre-OST0001 00010000:00010000:2.0:1789635335.251729:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789635335.827567:0:13082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79f90fb480 - data ffff9e79dc9716c0/ffff9e79fdc93400 00000020:01000000:0.0:1789635335.827716:0:13082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79c31a6f00 - data ffff9e79eefa2000/ffff9e79fec5d400 00000001:00000004:0.0:1789635335.838798:0:13082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789635335.997861:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789635335.997873:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789635335.997903:0:13082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789635335.997908:0:13082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789635335.998594:0:7153:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789635335.998601:0:7153:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789635335.998613:0:7153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789635336.004659:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789635336.004670:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789635336.004699:0:13082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789635336.004702:0:13082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789635336.005105:0:7650:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789635336.005111:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789635336.005123:0:7650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789635336.094037:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a55 00000020:00000080:0.0:1789635336.094053:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79cdff7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789635336.095453:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79cdff7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789635336.104706:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a6a 00000020:00000080:1.0:1789635336.104730:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79fedbd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789635336.104756:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789635336.104768:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635336.104781:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789635336.104786:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9e79feda4d40) has no exports 00000004:01000000:1.0:1789635336.105017:0:13082:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789635336.105033:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2c38 00000020:00000080:1.0:1789635336.105038:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79fe704000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789635336.105043:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789635336.105046:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635336.105053:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789635336.105056:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9e79e76a0000) has no exports 00000020:00000080:1.0:1789635336.105064:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2c31 00000020:00000080:1.0:1789635336.105069:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79fe703800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789635336.105614:0:13082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789635336.105621:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789635336.105627:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789635336.105635:0:13082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789635336.105638:0:13082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635336.105688:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635336.105697:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789635336.105705:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2bc1 00000020:00000080:1.0:1789635336.105712:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79c8ba9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789635336.105722:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789635336.105727:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635336.105732:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789635336.105735:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9e79fe9199c0) has no exports 00000020:00000080:1.0:1789635336.105741:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2bba 00000020:00000080:1.0:1789635336.105745:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79fe380800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789635336.106125:0:13082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789635336.106129:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789635336.106131:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789635336.106136:0:13082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789635336.106137:0:13082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635336.106168:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635336.106173:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789635336.106203:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635336.106207:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789635336.106236:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a71 00000020:00000080:1.0:1789635336.106241:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79fedb8800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789635336.106249:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789635336.106254:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635336.106257:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789635336.106259:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9e79feda0000) has no exports 00000020:00000080:1.0:1789635336.106281:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635336.106284:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789635336.106298:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a78 00000020:00000080:1.0:1789635336.106301:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79fedbe000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789635336.106343:0:13082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79c8241800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789635336.106347:0:13082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79c8241800 3 00000020:01000004:1.0:1789635336.106350:0:13082:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e79c8241800 from lustre-MDT0000 00000020:00000080:1.0:1789635336.106374:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635336.106379:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789635336.106382:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79cdff7800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789635336.106385:0:13082:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79cdff7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789635336.106396:0:13082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789635336.106497:0:13082:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789635336.106501:0:13082:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789635336.106504:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789635336.106507:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635336.106510:0:13082:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789635336.106518:0:13082:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9e79d01b0000 ec8828bc-aabc-4548-96aa-655e15bcddbb 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635336.106523:0:13082:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9e79f91919c0) has exports, disconnecting them 00000020:00080000:1.0:1789635336.106528:0:13082:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e79d01b0000), last request at 1789635148 00000020:00000080:1.0:1789635336.106546:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a16 00000020:00010000:1.0:1789635336.106551:0:13082:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e79d01b0000: total 7 00000100:00080000:1.0:1789635336.106556:0:13082:0:(import.c:65:import_set_state_nolock()) ffff9e79d01b7000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789635336.106575:0:13082:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e79d01b0000): rc 0 00000020:00080000:1.0:1789635336.106579:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9e79f91919c0) has no exports 00000100:00100000:1.0:1789635336.106709:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e79d107b800:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789635336.106819:0:5835:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e79d905c400:5835] 0 exiting: rc = 1 00000020:00010000:0.0:1789635336.110302:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e79d01b0000: total 7 00010000:00010000:0.0:1789635336.110430:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e79d01b0000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789635336.110499:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175400/0x77332204cfbb2f64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2f5d expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110529:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676400/0x77332204cfbb2d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2d11 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110542:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0031c00/0x77332204cfbb2f56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2f4f expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110560:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821a00/0x77332204cfbb2d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2d1f expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110572:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c1676800/0x77332204cfbb2d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2d2d expref: 5 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110583:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b84000/0x77332204cfbb2d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2d3b expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110596:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02175200/0x77332204cfbb2b2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2b27 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110609:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb2d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x77332204cfbb2d65 expref: 2 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635336.110622:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e79d01b0000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789635336.110635:0:5831:0:(genops.c:885:class_export_put()) final put ffff9e79d01b0000/ec8828bc-aabc-4548-96aa-655e15bcddbb 00010000:00010000:0.0:1789635336.110647:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635336.110649:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635336.110652:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635336.110707:0:7647:0:(service.c:3188:ptlrpc_main()) ll_mgs_0003: service thread [ffff9e79e7201000:7647] 3 exiting: rc = 0 00000100:00100000:0.0:1789635336.110870:0:5837:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e79d107b000:5837] 2 exiting: rc = 0 00000020:00000080:0.0:1789635336.110923:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fedbd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789635336.110931:0:1466:0:(genops.c:885:class_export_put()) final put ffff9e79cdff5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789635336.110933:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79cdff5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789635336.110939:0:1466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635336.111093:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe704000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789635336.111101:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe703800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635336.111109:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fe707800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789635336.111115:0:1466:0:(genops.c:885:class_export_put()) final put ffff9e79fe706800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789635336.111117:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe706800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789635336.111120:0:1466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635336.111150:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8ba9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789635336.111157:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe380800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635336.111162:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fe382800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789635336.111166:0:1466:0:(genops.c:885:class_export_put()) final put ffff9e79e73b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789635336.111168:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79e73b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789635336.111172:0:1466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789635336.111255:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fedb8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789635336.111260:0:1466:0:(genops.c:885:class_export_put()) final put ffff9e79cdff1800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789635336.111262:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79cdff1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789635336.111266:0:1466:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789635336.111483:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fedbe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635336.111489:0:1466:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79d01b0000/ec8828bc-aabc-4548-96aa-655e15bcddbb for MGS 00000020:00000080:0.0:1789635336.111529:0:1466:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79d01b7000 for MGS 00000100:00100000:1.0:1789635336.122485:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122497:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122503:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122511:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122517:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122522:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122529:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122552:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122559:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122566:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122573:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122579:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122585:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122592:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122599:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122608:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122614:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122619:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122625:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122632:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122639:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122645:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122652:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122658:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122667:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122675:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122681:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122688:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122693:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122699:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122705:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122712:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122718:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122725:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122732:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122738:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122744:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122751:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122757:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122764:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122770:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122776:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122790:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122796:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122802:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122807:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122813:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122819:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122825:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122830:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122836:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122842:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122848:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122854:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122859:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122865:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122870:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122877:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122883:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122888:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122894:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122900:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122905:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.122911:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789635336.123587:0:13082:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789635336.123593:0:13082:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789635336.126466:0:13082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79c80892a0 - data ffff9e79dc904510/ffff9e79e7168c00 00000020:01000000:1.0:1789635336.126642:0:13082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79c83282a0 - data ffff9e79f38800d8/ffff9e79c7a1b400 00000020:00000080:1.0:1789635336.127450:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb29fa 00000020:00000080:1.0:1789635336.127461:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79f918b000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789635336.127521:0:13082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79c8241800 from MGS, refs=2 00000020:01000004:1.0:1789635336.127526:0:13082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79c8241800 2 00000020:01000004:1.0:1789635336.127530:0:13082:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e79c8241800 from MGS 00000020:00000080:1.0:1789635336.127558:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635336.127568:0:13082:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789635336.127570:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79c8247800/MGS 00000020:00000080:1.0:1789635336.127573:0:13082:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8247800/MGS for MGS 00000020:01000000:1.0:1789635336.127603:0:13082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789635336.127678:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789635336.127682:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635336.127689:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789635336.127697:0:13082:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e79fedbe800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789635336.127704:0:13082:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9e79feda19c0) has exports, disconnecting them 00000020:00080000:1.0:1789635336.127710:0:13082:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e79fedbe800), last request at 1789635149 00000020:00000080:1.0:1789635336.127716:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2ac5 00000020:00080000:1.0:1789635336.127729:0:13082:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e79fedbe800): rc 0 00000020:00000080:1.0:1789635336.127734:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79fedbe800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789635336.128672:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79f918b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789635336.129754:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fedbe800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789635336.152456:0:13082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789635336.152485:0:13082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789635336.152490:0:13082:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789635336.152501:0:13082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789635336.152749:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635336.152761:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789635336.152770:0:13082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79c8241800 1 00000020:00000080:0.0:1789635336.152779:0:13082:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb29ec 00000020:00000080:0.0:1789635336.152791:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79c8244800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789635336.152797:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789635336.152804:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635336.152809:0:13082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789635336.152813:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9e79f9190000) has no exports 00000020:00000080:2.0:1789635336.152906:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fedbd800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789635336.152916:0:38:0:(genops.c:885:class_export_put()) final put ffff9e79fedbb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789635336.152920:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fedbb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789635336.152933:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789635336.153017:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8244800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789635336.199192:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635336.199212:0:13082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789635336.199249:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79c8244000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789635336.199257:0:13082:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8244000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789635336.199270:0:13082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789635336.199463:0:13082:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e79c8243800 00000020:01000000:2.0:1789635336.199494:0:13082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789635336.199499:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789635336.199505:0:13082:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789635336.199510:0:13082:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9e79c619cd40) has no exports 00000100:00100000:2.0:1789635336.199603:0:12994:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9e78c1879200:12994] 4 exiting: rc = 0 00000100:00100000:2.0:1789635336.199743:0:5843:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9e79c7282400:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1789635336.202675:0:5844:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9e79c5854200:5844] 2 exiting: rc = 0 00000100:00100000:1.0:1789635336.206525:0:5842:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9e79c7a85400:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1789635336.207873:0:7562:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9e79c7bf8a00:7562] 3 exiting: rc = 0 00000100:00100000:2.0:1789635336.208359:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208369:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208376:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208383:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208390:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208396:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208403:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208409:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208430:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208436:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208443:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208449:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208458:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208465:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208470:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208477:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208484:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208490:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208496:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208502:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208508:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208514:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208521:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208527:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208551:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208558:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208565:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208572:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208581:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208587:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208595:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208601:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208609:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208618:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208624:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208631:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208638:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208645:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208652:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208659:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208665:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208673:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208679:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208686:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208693:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208699:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208706:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208713:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208721:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208727:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208735:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208741:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208749:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208756:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208764:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208770:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208777:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208784:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208790:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208805:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208840:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208852:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208863:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.208870:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789635336.218657:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e79cde90800:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1789635336.219453:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e79c5855a00:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1789635336.219601:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219612:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219619:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219628:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219636:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219643:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219653:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219658:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219666:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219673:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219678:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219686:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219693:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219698:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219704:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219710:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219716:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219723:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219729:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219735:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219740:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219745:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219751:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219757:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219763:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219769:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219775:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219790:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219797:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219802:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219823:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219829:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219835:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219840:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219845:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219851:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219856:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219861:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219866:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219872:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219877:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219882:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219888:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219893:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219899:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219904:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219910:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219915:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219921:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219927:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219934:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219940:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219946:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219952:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219958:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219964:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219969:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219975:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219981:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219986:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219992:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.219997:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.220003:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.220010:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.221623:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9e79cde90600:5847] 0 exiting: rc = 1 00000100:00100000:0.0:1789635336.221750:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9e79cde90a00:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1789635336.221859:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221881:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221889:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221896:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221927:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221935:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221942:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221949:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221956:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221963:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221970:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.221991:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222000:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222007:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222014:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222021:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222028:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222034:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222042:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222049:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222057:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222063:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222070:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222095:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222105:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222112:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222119:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222127:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222134:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222154:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222161:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222168:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222180:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222187:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222194:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222371:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222388:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222395:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222402:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222421:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222430:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222437:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222444:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222451:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222458:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222465:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222473:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222497:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222505:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222511:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222518:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222524:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222532:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222538:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222546:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222552:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222559:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222572:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222579:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222601:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222610:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222617:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222624:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.222631:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.242778:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e79cde91400:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789635336.242958:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e79cde91a00:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1789635336.243688:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243699:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243706:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243712:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243718:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243726:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243732:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243756:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243762:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243769:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243775:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243781:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243787:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243793:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243799:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243806:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243812:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243818:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243824:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243829:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243836:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243842:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243848:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243853:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243859:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243865:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243871:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243876:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243882:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243888:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243894:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243899:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243905:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243911:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243917:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243924:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243929:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243935:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243942:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243948:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243954:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243960:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243977:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243983:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243988:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.243994:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244000:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244006:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244012:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244018:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244023:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244029:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244035:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244041:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244047:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244053:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244059:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244065:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244072:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244078:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244084:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244089:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244096:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.244101:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.244823:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e79f91dec00:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1789635336.246447:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e79f91de000:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1789635336.247193:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247203:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247211:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247228:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247234:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247239:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247246:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247252:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247258:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247266:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247272:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247279:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247285:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247292:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247336:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247341:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247347:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247353:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247359:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247365:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247372:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247441:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247448:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247454:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247460:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247465:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247471:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247476:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247482:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247488:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247495:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247501:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247506:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247512:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247518:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247524:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247530:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247536:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247542:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247548:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247554:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247560:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247566:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247572:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247578:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247585:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247591:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247598:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247604:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247618:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247624:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247630:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247636:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247641:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247647:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247653:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247660:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247666:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247673:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247680:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247687:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247693:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247700:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.247706:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.248183:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e79c8b03200:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1789635336.248832:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e79f91df200:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1789635336.254422:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254437:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254444:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254450:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254457:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254463:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254481:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254487:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254493:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254498:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254504:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254510:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254515:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254539:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254545:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254550:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254557:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254562:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254568:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254575:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254581:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254588:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254594:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254599:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254605:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254610:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254616:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254622:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254628:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254635:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254641:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254647:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254654:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254660:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254667:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254673:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254679:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254686:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254692:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254698:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254704:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254712:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254719:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254725:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254732:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254738:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254745:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254751:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254764:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254770:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254776:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254783:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254789:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254796:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254803:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254809:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254816:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254822:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254829:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254835:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254841:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254847:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254853:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.254860:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635336.256018:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9e79c7aabe00:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1789635336.256654:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9e79f91dee00:5857] 2 exiting: rc = 0 00000100:00100000:0.0:1789635336.256913:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9e79f91dfc00:5856] 1 exiting: rc = 0 00000100:00100000:2.0:1789635336.257093:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257103:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257110:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257117:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257124:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257130:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257137:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257144:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257150:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257159:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257166:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257175:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257183:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257189:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257197:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257206:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257214:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257370:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257391:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257397:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257404:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257422:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257434:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257441:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257448:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257456:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257474:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257482:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257488:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257495:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257502:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257510:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257518:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257526:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257533:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257540:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257546:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257554:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257561:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257567:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257574:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257597:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257606:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257612:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257618:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257624:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257632:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257641:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257648:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257655:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257662:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257669:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257676:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257689:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257695:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257702:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257709:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257716:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257723:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257729:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257735:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257742:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257748:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635336.257755:0:13082:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789635336.264931:0:13082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635336.264951:0:13082:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789635336.264959:0:13082:0:(genops.c:885:class_export_put()) final put ffff9e79c8246000/MDS_uuid 00000020:00000080:2.0:1789635336.264966:0:13082:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8246000/MDS_uuid for MDS 00000020:01000000:2.0:1789635336.264973:0:13082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789635336.265162:0:13082:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789635336.300840:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635336.477848:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422035456:0@lo:400:kworker.0 00000400:00000100:1.0:1789635336.477925:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876568422035456 offset 0 length 224: 4 00000100:00100000:1.0:1789635336.478067:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635336.478077:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422035584:0@lo:400:kworker.0 00000400:00000100:1.0:1789635336.478101:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568422035584 offset 0 length 224: 4 00000100:00100000:1.0:1789635336.478133:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422035712:0@lo:400:kworker.0 00000400:00000100:1.0:1789635336.478152:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568422035712 offset 0 length 224: 4 00000001:00100000:2.0:1789635336.583629:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789635336.583642:0:6717:0:(genops.c:885:class_export_put()) final put ffff9e79e7879800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789635336.583692:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79e7879800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789635336.583762:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79e7879000 for lustre-OST0000 00010000:00010000:2.0:1789635337.373530:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635338.389566:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635339.411444:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789635339.595121:0:13235:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789635339.630490:0:13235:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789635339.630544:0:13235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635339.630560:0:13235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635339.630642:0:13235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635339.630651:0:13235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635339.630759:0:13235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789635339.630767:0:13235:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789635339.630790:0:13235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635339.630803:0:13235:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79fe904e00 x1876568422035584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635352 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635339.630824:0:13235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789635339.630832:0:13235:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789635339.630868:0:13235:0:(import.c:65:import_set_state_nolock()) ffff9e79e4a6a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789635339.631182:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876568422035840:0@lo:39:umount.0 00000400:00000100:2.0:1789635339.631236:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568422035840 offset 0 length 224: 4 00000100:00100000:1.0:1789635339.631534:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422035584:0@lo:400:kworker.0 00010000:00010000:0.0:1789635339.631985:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635339.631994:0:7641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635339.632003:0:7641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031800 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635339.632007:0:7641:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635339.632017:0:7641:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635339.632025:0:7641:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635339.632050:0:7641:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635339.632053:0:7641:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789635339.632056:0:7641:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789635339.632087:0:7641:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635339.632093:0:7641:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789635339.632251:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422035968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635339.632294:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789635339.632392:0:7641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635339.632401:0:7641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c0031800/0x77332204cfbb2d2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x77332204cfbb2d34 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635339.632415:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635339.632417:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635339.632418:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635339.632564:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422035968 00000100:00100000:2.0:1789635339.632637:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422035968 00000100:00100000:2.0:1789635339.632797:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635339.632805:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1876568422035968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789635339.632812:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789635339 with bad export cookie 8589246318386031126 00000100:00100000:0.0:1789635339.649852:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1876568422035968:12345-0@lo:103:ldlm_bl.0 Request processed in 17038us (17548us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789635339.649869:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789635339.649967:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789635339.649973:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9e79c8242800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789635339.649977:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789635339.666876:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789635339.666882:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789635339.666892:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79fe904a80 x1876568422035456/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789635352 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635339.666917:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79dba5d880 x1876568422035968/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789635355 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789635339.666937:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789635339.666940:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789635339.666942:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789635339.666945:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9e79c8242800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635339.666949:0:3307:0:(import.c:545:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 124 00000100:00080000:1.0:1789635339.666966:0:3307:0:(import.c:666:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e79c8242800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789635339.667869:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ec8828bc-aabc-4548-96aa-655e15bcddbb:3308:1876568422035456:0@lo:400:kworker.0 00000100:00100000:0.0:1789635339.667927:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79dba5c000 x1876568422036096/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635339.667950:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ec8828bc-aabc-4548-96aa-655e15bcddbb:3307:1876568422035968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635339.668592:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec8828bc-aabc-4548-96aa-655e15bcddbb:3305:1876568422036096:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789635339.668650:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876568422036096 offset 0 length 520: 4 00010000:00010000:2.0:1789635340.436379:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635341.460688:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635341.588280:0:1466:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789635341.588288:0:1466:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789635341.588413:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422036224:0@lo:400:kworker.0 00000400:00000100:0.0:1789635341.588457:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568422036224 offset 0 length 224: 4 00010000:00010000:0.0:1789635342.483815:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635343.507614:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635344.531615:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789635344.595623:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789635344.595634:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789635344.595788:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422036352:0@lo:400:kworker.0 00000400:00000100:2.0:1789635344.595872:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568422036352 offset 0 length 224: 4 00010000:00010000:2.0:1789635345.558045:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635346.579701:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635347.605718:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635348.627716:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635349.270127:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635339/real 1789635339] req@ffff9e79dba5c000 x1876568422036096/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789635349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635349.270171:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e79dba5c000 x1876568422036096/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789635349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635349.270194:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635339/real 1789635339] req@ffff9e79e7efe300 x1876568422035840/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635349.270208:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e79e7efe300 x1876568422035840/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789635349.270230:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79c8242800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635349.270259:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789635349.270264:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec8828bc-aabc-4548-96aa-655e15bcddbb:3305:1876568422036096:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1789635349.270271:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79e4a6a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789635349.270286:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876568422035840:0@lo:39:umount.0 00000100:00080000:1.0:1789635349.270396:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789635349.270407:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789635349.270411:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79c8242800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635349.270419:0:38:0:(import.c:545:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 315 00000100:00080000:1.0:1789635349.270426:0:38:0:(import.c:630:import_select_connection()) MGC192.168.201.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789635349.270440:0:38:0:(import.c:666:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e79c8242800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789635349.270480:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fe905c00 x1876568422036480/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635349.270631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422036608:0@lo:400:kworker.0 00000400:00000100:0.0:1789635349.270680:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568422036608 offset 0 length 224: 4 00000100:00100000:2.0:1789635349.270932:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec8828bc-aabc-4548-96aa-655e15bcddbb:3305:1876568422036480:0@lo:250:kworker.0 00000400:00000100:2.0:1789635349.270956:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876568422036480 offset 0 length 520: 4 00000100:00080000:3.0:1789635349.271348:0:13235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789635349.271354:0:13235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789635349.271360:0:13235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789635349.272671:0:13235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.272703:0:13235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.272710:0:13235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.272716:0:13235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.272744:0:13235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635349.272751:0:13235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.272757:0:13235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.272762:0:13235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.272769:0:13235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635349.273429:0:13235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789635349.273434:0:13235:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789635349.273454:0:13235:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789635349.273457:0:13235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789635349.273462:0:13235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635349.273468:0:13235:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789635349.273471:0:13235:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9e79e74419c0) has no exports 00000020:00080000:3.0:1789635349.273500:0:13235:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9e79e74419c0) has no exports 00000020:01000000:3.0:1789635349.276563:0:13235:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79e7913480 - data ffff9e79dc96c438/ffff9e79e7c74400 00000020:01000000:3.0:1789635349.276720:0:13235:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79c8b5dd20 - data ffff9e79f3bfd288/ffff9e79c8ac6400 00010000:00010000:0.0:1789635349.284371:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635349.284619:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635349.284633:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031a00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635349.284637:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635349.284650:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635349.284657:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635349.284663:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789635349.284666:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789635349.284670:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789635349.284689:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e79c8242800 00010000:00010000:0.0:1789635349.284693:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635349.284700:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c0031a00/0x77332204cfbb2d3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2d42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635349.284781:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635349.284788:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635349.284796:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02175e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635349.284815:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635349.284823:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635349.284830:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635349.284835:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789635349.284847:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789635349.284849:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789635349.284855:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e79c8242800 00010000:00010000:1.0:1789635349.284858:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635349.284865:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e7a02175e00/0x77332204cfbb2f5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2f64 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635349.284875:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635349.284877:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635349.284879:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635349.287642:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789635349.297444:0:13235:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789635349.377589:0:13235:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2b4a 00000020:00000080:0.0:1789635349.377614:0:13235:0:(genops.c:885:class_export_put()) final put ffff9e79fd900000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789635349.377626:0:13235:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79fb977800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789635349.377629:0:13235:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79fb977800 2 00000020:01000004:0.0:1789635349.377632:0:13235:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e79fb977800 from lustre-OST0000 00000020:00000080:0.0:1789635349.377655:0:13235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789635349.377665:0:13235:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789635349.377667:0:13235:0:(genops.c:885:class_export_put()) final put ffff9e79e4a6a800/lustre-OST0000_UUID 00000020:00000080:0.0:1789635349.377670:0:13235:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79e4a6a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789635349.377677:0:13235:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789635349.377777:0:13235:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789635349.377781:0:13235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789635349.377785:0:13235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789635349.377790:0:13235:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789635349.377797:0:13235:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e79c7272800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789635349.377803:0:13235:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9e79e76a3380) has exports, disconnecting them 00000020:00080000:0.0:1789635349.377807:0:13235:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e79c7272800), last request at 1789635160 00000020:00000080:0.0:1789635349.377812:0:13235:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2b74 00000020:00080000:0.0:1789635349.377821:0:13235:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e79c7272800): rc 0 00000020:00000080:0.0:1789635349.377825:0:13235:0:(genops.c:885:class_export_put()) final put ffff9e79c7272800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789635349.378483:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fd900000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789635349.378497:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c7272800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789635349.480211:0:13235:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789635349.480222:0:13235:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789635349.480226:0:13235:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789635349.480234:0:13235:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635349.480454:0:13235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789635349.480471:0:13235:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789635349.480478:0:13235:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79fb977800 1 00000020:00000080:1.0:1789635349.480484:0:13235:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2b04 00000020:00000080:1.0:1789635349.480492:0:13235:0:(genops.c:885:class_export_put()) final put ffff9e79fedb9000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789635349.480498:0:13235:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789635349.480502:0:13235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635349.480505:0:13235:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789635349.480509:0:13235:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9e79c6198000) has no exports 00000020:00000080:2.0:1789635349.480628:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79e4a6a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789635349.480636:0:38:0:(genops.c:885:class_export_put()) final put ffff9e79c7274000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789635349.480638:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c7274000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789635349.480651:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789635349.480698:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fedb9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789635349.520572:0:13235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635349.520589:0:13235:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789635349.520595:0:13235:0:(genops.c:885:class_export_put()) final put ffff9e79c8b0f800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789635349.520599:0:13235:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8b0f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789635349.520610:0:13235:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789635349.520746:0:13235:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e79c8b0b000 00000020:02000400:2.0:1789635349.520790:0:13235:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789635349.928555:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635350.933139:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635351.965484:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789635352.342056:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635336/real 1789635336] req@ffff9e79fe905500 x1876568422035712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635352 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635352.418091:0:3306:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e79fe905500 x1876568422035712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789635352 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635352.418107:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9e79fdd1c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789635352.418112:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789635352.472103:0:3306:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1789635352.473544:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789635352.473551:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789635352.473554:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789635352.473557:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789635352.473562:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79fdd1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635352.473570:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 148 00000100:00080000:2.0:1789635352.473584:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e79fdd1c800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635352.473620:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e78c1383100 x1876568422036736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635352.473757:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876568422036736:0@lo:38:kworker.0 00000400:00000100:2.0:1789635352.473809:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876568422036736 offset 0 length 520: 4 00000100:00100000:2.0:1789635352.473872:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422035712:0@lo:400:kworker.0 00010000:00010000:2.0:1789635352.983248:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635354.004540:0:7641:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789635354.332743:0:13387:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789635354.394412:0:13387:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789635354.394479:0:13387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.394629:0:13387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.394639:0:13387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.394646:0:13387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635354.394669:0:13387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789635354.394674:0:13387:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789635354.394698:0:13387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789635354.394711:0:13387:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79e7efed80 x1876568422036224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635357 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635354.394803:0:13387:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79fe906300 x1876568422036352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635354.394819:0:13387:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79fe905f80 x1876568422036608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635365 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635354.394834:0:13387:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e78c1383100 x1876568422036736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789635362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635354.394845:0:13387:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789635354.394870:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422036608:0@lo:400:kworker.0 00000100:00080000:2.0:1789635354.394912:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fdd1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789635354.394928:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1789635354.394932:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876568422036736:0@lo:38:kworker.0 00000100:00080000:2.0:1789635354.394949:0:13387:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789635354.394954:0:13387:0:(import.c:65:import_set_state_nolock()) ffff9e79fdd1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789635354.394959:0:13387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789635354.394963:0:13387:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79e7efed80 x1876568422036224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635357 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635354.395020:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422036352:0@lo:400:kworker.0 00010000:00010000:3.0:1789635354.395077:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635354.395096:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.395105:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84200 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635354.395109:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.395119:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635354.395126:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635354.395130:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789635354.395133:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789635354.395135:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789635354.395149:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e79c8242800 00010000:00010000:3.0:1789635354.395153:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.395158:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb2d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2d18 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.395179:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635354.395181:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635354.395188:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635354.403578:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422036224:0@lo:400:kworker.0 00000100:00100000:2.0:1789635354.403644:0:13387:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79fe906300 x1876568422036352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635360 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635354.403657:0:13387:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789635354.422524:0:13387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789635354.437078:0:13387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437108:0:13387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437116:0:13387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437124:0:13387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437172:0:13387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635354.437180:0:13387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437187:0:13387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437192:0:13387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437197:0:13387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635354.437222:0:13387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789635354.437227:0:13387:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789635354.437249:0:13387:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789635354.437254:0:13387:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789635354.437258:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789635354.437264:0:13387:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789635354.437268:0:13387:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9e79fe91b380) has no exports 00000020:00080000:1.0:1789635354.437292:0:13387:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9e79fe91b380) has no exports 00010000:00010000:3.0:1789635354.439288:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635354.439302:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439327:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676e00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635354.439332:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439343:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635354.439349:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635354.439355:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789635354.439357:0:7642:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789635354.439360:0:7642:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789635354.439377:0:7642:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e79c8242800 00010000:00010000:3.0:1789635354.439381:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439387:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1676e00/0x77332204cfbb2d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2d26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439402:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635354.439406:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439411:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72c00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635354.439413:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439435:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635354.439440:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635354.439445:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789635354.439447:0:7642:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789635354.439449:0:7642:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789635354.439454:0:7642:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e79c8242800 00010000:00010000:3.0:1789635354.439456:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439465:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72c00/0x77332204cfbb2f4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2f56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.439477:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635354.439479:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635354.439480:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635354.440795:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789635354.454204:0:13387:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79c7265d20 - data ffff9e79ca020360/ffff9e78c1991400 00000020:01000000:0.0:1789635354.454393:0:13387:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e79e727c9c0 - data ffff9e79dc817d80/ffff9e79fdd06400 00000100:00080000:1.0:1789635354.515540:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789635354.515553:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00100000:10000000:0.0:1789635354.516510:0:13387:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789635354.559745:0:13387:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2c62 00000020:00000080:3.0:1789635354.559757:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79dc0e5000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789635354.559809:0:13387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79fe5fc000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789635354.559813:0:13387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79fe5fc000 2 00000020:01000004:3.0:1789635354.559816:0:13387:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e79fe5fc000 from lustre-OST0001 00000020:00000080:3.0:1789635354.559842:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635354.559853:0:13387:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789635354.559855:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79fe5fa000/lustre-OST0001_UUID 00000020:00000080:3.0:1789635354.559858:0:13387:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe5fa000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789635354.559866:0:13387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789635354.559971:0:13387:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ec8828bc-aabc-4548-96aa-655e15bcddbb->MGS 00010000:00010000:3.0:1789635354.560005:0:13387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2b2e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635354.560017:0:13387:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2b2e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635354.560024:0:13387:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789635354.560026:0:13387:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789635354.560030:0:13387:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789635354.560046:0:13387:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e79c8242800 00010000:00010000:3.0:1789635354.560049:0:13387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1677800/0x77332204cfbb2b27 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2b2e expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635354.560221:0:13387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x77332204cfbb2d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635354.560229:0:13387:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x77332204cfbb2d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635354.560234:0:13387:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789635354.560237:0:13387:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789635354.560238:0:13387:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789635354.560251:0:13387:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e79c8242800 00010000:00010000:3.0:1789635354.560254:0:13387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79fe821800/0x77332204cfbb2d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x77332204cfbb2d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789635354.560270:0:13387:0:(import.c:65:import_set_state_nolock()) ffff9e79c8242800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789635354.560275:0:13387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789635354.560277:0:13387:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789635354.560279:0:13387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789635354.560283:0:13387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789635354.560295:0:13387:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e79fe905c00 x1876568422036480/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789635364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789635354.560438:0:13387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789635354.560442:0:13387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000020:00000080:1.0:1789635354.560627:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79dc0e5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1789635354.560674:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ec8828bc-aabc-4548-96aa-655e15bcddbb:3305:1876568422036480:0@lo:250:kworker.0 10000000:01000000:3.0:1789635354.560735:0:13387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789635354.560742:0:13387:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2a08 00000020:00000080:3.0:1789635354.560748:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79c8247000/ec8828bc-aabc-4548-96aa-655e15bcddbb 00000020:01000000:3.0:1789635354.560760:0:13387:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.130@tcp (flags='') 00000020:00000080:3.0:1789635354.560766:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635354.560772:0:13387:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789635354.560775:0:13387:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9e79c61999c0) has no exports 10000000:01000000:1.0:1789635354.560830:0:5839:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1789635354.560881:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8247000/ec8828bc-aabc-4548-96aa-655e15bcddbb for MGC192.168.201.130@tcp 10000000:01000000:3.0:1789635354.560975:0:13387:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.130@tcp: client import never connected 00000100:00080000:3.0:1789635354.560978:0:13387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789635354.560980:0:13387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789635354.560982:0:13387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789635354.560984:0:13387:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789635354.561014:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789635354.561019:0:13387:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.130@tcp (uuid ec8828bc-aabc-4548-96aa-655e15bcddbb) 00000020:01000000:3.0:1789635354.561025:0:13387:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789635354.561028:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789635354.561031:0:13387:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789635354.561035:0:13387:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e79dc2fb800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789635354.561040:0:13387:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff9e79f9194d40) has exports, disconnecting them 00000020:00080000:3.0:1789635354.561045:0:13387:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e79dc2fb800), last request at 1789635172 00000020:00000080:3.0:1789635354.561049:0:13387:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2c8c 00000020:00080000:3.0:1789635354.561058:0:13387:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e79dc2fb800): rc 0 00000020:00000080:3.0:1789635354.561138:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79dc2fb800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789635354.561996:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79dc2fb800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789635354.562529:0:13387:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789635354.562534:0:13387:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789635354.562538:0:13387:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789635354.562544:0:13387:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789635354.564800:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79c8242800 for MGC192.168.201.130@tcp 00000020:00000080:1.0:1789635354.564831:0:38:0:(genops.c:885:class_export_put()) final put ffff9e79c8abb800/ec8828bc-aabc-4548-96aa-655e15bcddbb 00000020:00000080:1.0:1789635354.564834:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79c8abb800/ec8828bc-aabc-4548-96aa-655e15bcddbb for MGC192.168.201.130@tcp 00000020:01000000:1.0:1789635354.564843:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.130@tcp (ec8828bc-aabc-4548-96aa-655e15bcddbb) 00000020:00000080:1.0:1789635354.565755:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e79fdd1c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789635354.569406:0:7641:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789635354.569726:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789635354.569859:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789635354.569989:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1789635354.570154:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e79cdfb0200:5825] 0 exiting: rc = 1 00000100:00100000:1.0:1789635354.570243:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e79cdfb1200:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1789635354.570356:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.570615:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e79cdfb1e00:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1789635354.570789:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e79cdfb1800:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1789635354.570845:0:6707:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e79e735fa00:6707] 3 exiting: rc = 0 00000100:00100000:1.0:1789635354.571393:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e79cdfb1000:5829] 2 exiting: rc = 0 00000100:00100000:2.0:1789635354.571495:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571505:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571511:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571518:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571523:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571529:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571535:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571541:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571562:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571568:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571573:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571579:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571585:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571590:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571596:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571601:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571608:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571613:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571617:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571622:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571626:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571631:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571635:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571640:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571645:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571649:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571654:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571660:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571664:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571669:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571674:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571680:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571685:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571690:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571695:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571701:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571707:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571711:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571716:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571721:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571727:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571733:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571737:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571751:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571756:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571761:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571766:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571772:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571777:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571783:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571789:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571794:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571799:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571804:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571809:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571814:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571819:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571824:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571829:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571835:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571840:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571845:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571850:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.571856:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789635354.574622:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635354.574639:0:13387:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789635354.574645:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79fdd18000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789635354.574650:0:13387:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fdd18000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789635354.574658:0:13387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789635354.574720:0:13387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79fe5fc000 1 00000020:00000080:2.0:1789635354.574726:0:13387:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x77332204cfbb2be4 00000020:00000080:2.0:1789635354.574732:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79fe706000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789635354.574749:0:13387:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789635354.574754:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789635354.574759:0:13387:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789635354.574762:0:13387:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9e79fe91cd40) has no exports 00000020:00000080:1.0:1789635354.574974:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe706000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789635354.606614:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635354.606640:0:13387:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789635354.606646:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79fe5fd000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789635354.606651:0:13387:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fe5fd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789635354.606660:0:13387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789635354.606840:0:13387:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e79fe5ff800 00000020:01000000:2.0:1789635354.606861:0:13387:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789635354.606865:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789635354.606869:0:13387:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789635354.606873:0:13387:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9e79fe918000) has no exports 00000020:00000080:2.0:1789635354.610337:0:13387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789635354.610359:0:13387:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789635354.610365:0:13387:0:(genops.c:885:class_export_put()) final put ffff9e79fedbc000/OSS_uuid 00000020:00000080:2.0:1789635354.610369:0:13387:0:(genops.c:844:class_export_destroy()) destroying export ffff9e79fedbc000/OSS_uuid for OSS 00000020:01000000:2.0:1789635354.610375:0:13387:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789635354.610617:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9e79fe2e4c00:6691] 0 exiting: rc = 1 00000100:00100000:3.0:1789635354.611143:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9e79c725d400:6694] 2 exiting: rc = 0 00000100:00080000:0.0:1789635354.622129:0:5838:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789635354.622334:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9e79c725ce00:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1789635354.649436:0:8106:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9e79e76b4e00:8106] 3 exiting: rc = 0 00000100:00100000:2.0:1789635354.649571:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649581:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649588:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649597:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649602:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649607:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649613:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649622:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649628:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649633:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649639:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649643:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649648:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649653:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649658:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649663:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649667:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649673:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649694:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649710:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649715:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649720:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649726:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649734:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649738:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649744:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649748:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649753:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649758:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649763:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649768:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649772:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649777:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649782:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649787:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649792:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649796:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649800:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649806:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649811:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649816:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649820:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649826:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649830:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649835:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649840:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649845:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649849:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649855:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649861:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649866:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649870:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649875:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649887:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649907:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649913:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649918:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649922:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649928:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649932:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649937:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649942:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649947:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.649952:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.650738:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e79c725c000:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1789635354.659959:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e79c725dc00:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1789635354.660075:0:7560:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9e79c834b000:7560] 2 exiting: rc = 0 00000100:00100000:2.0:1789635354.666747:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666757:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666763:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666769:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666775:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666780:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666785:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666791:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666796:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666801:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666807:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666812:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666817:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666821:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666826:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666831:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666836:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666840:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666844:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666849:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666854:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666859:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666863:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666882:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666969:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666977:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666983:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666988:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666993:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.666998:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667003:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667008:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667013:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667018:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667022:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667027:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667033:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667038:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667044:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667049:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667054:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667059:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667132:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667138:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667143:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667149:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667153:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667158:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667162:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667395:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667405:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667410:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667414:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667419:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667424:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667430:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667434:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667439:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667453:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667458:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667463:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667468:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667473:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.667478:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.669123:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e79c725da00:6698] 1 exiting: rc = 0 00000100:00100000:2.0:1789635354.669305:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e79c725ca00:6699] 2 exiting: rc = 0 00000100:00100000:0.0:1789635354.670265:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e79c725c800:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1789635354.670722:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670731:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670736:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670741:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670746:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670752:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670766:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670773:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670778:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670783:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670788:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670793:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670798:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670804:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670809:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670815:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670821:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670825:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670831:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670836:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670842:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670847:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670853:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670869:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670876:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.670881:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671011:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671031:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671037:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671042:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671046:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671051:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671056:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671074:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671091:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671098:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671103:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671108:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671114:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671120:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671125:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671130:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671135:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671140:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671145:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671151:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671156:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671763:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671774:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671780:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671786:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671792:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671798:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671805:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671811:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671817:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671822:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671828:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671833:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671839:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671845:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671852:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671869:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.671875:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789635354.682571:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e79c725d600:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1789635354.683579:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e79c725de00:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1789635354.683655:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683664:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683670:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683676:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683680:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683685:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683690:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683694:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683699:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683703:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683708:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683712:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683718:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683723:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683728:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683733:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683738:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683743:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683749:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683754:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683759:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683764:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683769:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683774:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683779:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683784:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683789:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683795:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683801:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683806:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683811:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683816:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683832:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683838:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683843:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683848:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683853:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683857:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683862:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683868:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683873:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683878:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683883:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.683888:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684029:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684034:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684038:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684044:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684049:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684053:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684058:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684063:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684068:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684073:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684078:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684094:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684099:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684104:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684108:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684114:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684119:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684124:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684130:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.684135:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686151:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e79c725d000:6702] 0 exiting: rc = 1 00000100:00100000:2.0:1789635354.686246:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e79c8332c00:6703] 1 exiting: rc = 0 00000100:00100000:2.0:1789635354.686456:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686474:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686501:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686509:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686515:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686524:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686530:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686550:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686556:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686564:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686573:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686581:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686597:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686608:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686616:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686622:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686628:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686634:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686640:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686666:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686674:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686679:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686685:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686691:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686698:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686704:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686709:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686715:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686721:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686727:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686733:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686755:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686762:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686768:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686774:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686780:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686791:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686797:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686802:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686809:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686815:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686821:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686828:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686852:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686858:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686863:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686868:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686874:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.686881:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687238:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687249:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687257:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687263:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687269:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687277:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687385:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687393:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687399:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687406:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687413:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687419:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687426:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687432:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789635354.687439:0:13387:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789635354.714762:0:13387:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789635377.703198:0:14005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789635388.258899:0:14466:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789635388.258905:0:14466:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789635388.259019:0:14466:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e79e734d800 00000020:01000004:2.0:1789635388.259036:0:14466:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789635388.259044:0:14466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789635388.259058:0:14466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e79e76a3380) 00000020:00000080:2.0:1789635388.259084:0:14466:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789635388.299245:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789635388.309251:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789635388.310616:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1789635388.310725:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1789635388.310811:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1789635388.310888:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1789635388.310994:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1789635388.311169:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789635388.312202:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1789635388.312827:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1789635388.316864:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 594: rc = 0 00100000:10000000:2.0:1789635388.316981:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 594: rc = 0 00100000:10000000:2.0:1789635388.319679:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 326: rc = 0 00100000:10000000:2.0:1789635388.320001:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 326: rc = 0 00100000:10000000:2.0:1789635388.322933:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 326: rc = 0 00100000:10000000:2.0:1789635388.327247:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 326: rc = 0 00100000:10000000:2.0:1789635388.328860:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 326: rc = 0 00100000:10000000:2.0:1789635388.331916:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 326: rc = 0 00100000:10000000:2.0:1789635388.333939:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 326: rc = 0 00100000:10000000:2.0:1789635388.336564:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 326: rc = 0 00100000:10000000:2.0:1789635388.336960:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 326: rc = 0 00100000:10000000:2.0:1789635388.337753:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 326: rc = 0 00100000:10000000:2.0:1789635388.338007:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 326: rc = 0 00100000:10000000:3.0:1789635388.341948:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 326: rc = 0 00100000:10000000:3.0:1789635388.343236:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 619: rc = 0 00100000:10000000:3.0:1789635388.343785:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 619: rc = 0 00100000:10000000:3.0:1789635388.344305:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 619: rc = 0 00100000:10000000:3.0:1789635388.344905:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 619: rc = 0 00100000:10000000:3.0:1789635388.346622:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 619: rc = 0 00100000:10000000:3.0:1789635388.349234:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 619: rc = 0 00100000:10000000:3.0:1789635388.350817:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 619: rc = 0 00100000:10000000:3.0:1789635388.351260:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 619: rc = 0 00100000:10000000:3.0:1789635388.351649:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 619: rc = 0 00100000:10000000:3.0:1789635388.351878:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 619: rc = 0 00100000:10000000:3.0:1789635388.356694:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 619: rc = 0 00100000:10000000:3.0:1789635388.357026:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 619: rc = 0 00100000:10000000:3.0:1789635388.357298:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 619: rc = 0 00100000:10000000:3.0:1789635388.357591:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 619: rc = 0 00100000:10000000:3.0:1789635388.357832:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 619: rc = 0 00100000:10000000:3.0:1789635388.358075:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 619: rc = 0 00100000:10000000:3.0:1789635388.358287:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 619: rc = 0 00100000:10000000:3.0:1789635388.359555:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 619: rc = 0 00100000:10000000:3.0:1789635388.360055:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 619: rc = 0 00100000:10000000:3.0:1789635388.360816:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 619: rc = 0 00100000:10000000:3.0:1789635388.361772:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 619: rc = 0 00100000:10000000:3.0:1789635388.362194:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 619: rc = 0 00100000:10000000:3.0:1789635388.362774:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 619: rc = 0 00100000:10000000:3.0:1789635388.363562:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 619: rc = 0 00100000:10000000:3.0:1789635388.363839:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 619: rc = 0 00100000:10000000:3.0:1789635388.364806:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 619: rc = 0 00100000:10000000:3.0:1789635388.365598:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 619: rc = 0 00100000:10000000:3.0:1789635388.366412:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 619: rc = 0 00100000:10000000:3.0:1789635388.368305:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 619: rc = 0 00100000:10000000:3.0:1789635388.368950:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 619: rc = 0 00100000:10000000:3.0:1789635388.369526:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 619: rc = 0 00100000:10000000:3.0:1789635388.369795:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 619: rc = 0 00100000:10000000:3.0:1789635388.370629:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 608: rc = 0 00100000:10000000:2.0:1789635388.373369:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789635388.373573:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 595: rc = 0 00100000:10000000:2.0:1789635388.373804:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789635388.373870:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 595: rc = 0 00100000:10000000:2.0:1789635388.375931:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789635388.377795:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 595: rc = 0 00100000:10000000:2.0:1789635388.381179:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789635388.381263:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 597: rc = 0 00100000:10000000:2.0:1789635388.381507:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789635388.381574:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 597: rc = 0 00100000:10000000:2.0:1789635388.381779:0:14466:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789635388.381852:0:14466:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 597: rc = 0 00000020:00000080:2.0:1789635388.382125:0:14466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789635388.382134:0:14466:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789635388.382144:0:14466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb3cf4 00000020:01000004:2.0:1789635388.382152:0:14466:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789635388.382157:0:14466:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789635388.382163:0:14466:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e79e734d800 from MGS 00000020:01000004:2.0:1789635388.382167:0:14466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789635388.382177:0:14466:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e79e76a19c0) 00000020:00000080:2.0:1789635388.382186:0:14466:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789635388.382232:0:14466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79e734d800 from MGS, refs=2 00080000:01000000:2.0:1789635388.382236:0:14466:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789635388.382240:0:14466:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb3d02 00000100:00100000:2.0:1789635388.382368:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789635388.390042:0:14466:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789635388.390058:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789635388.391643:0:14466:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789635388.391652:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789635388.393044:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635388.393226:0:14466:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789635388.393232:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789635388.403948:0:14466:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789635388.403963:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789635388.414423:0:14466:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789635388.414444:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789635388.415355:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635388.415358:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635388.415361:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635388.415780:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635388.415783:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635388.415785:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635388.416933:0:14466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789635388.419293:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789635388.459574:0:14466:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789635388.459596:0:14466:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789635388.459599:0:14466:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789635388.461728:0:14475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789635388.461881:0:14466:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789635388.461978:0:14466:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789635388.462468:0:14466:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789635388.462887:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635388.463062:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789635388.463068:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789635388.480569:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789635388.480581:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789635388.481612:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789635388.481621:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789635388.482409:0:14466:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789635388.482540:0:14466:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.130@tcp' 00000020:01000004:1.0:1789635388.482542:0:14466:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789635388.482576:0:14466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.130@tcp (typ=mgc) 00000020:00000080:1.0:1789635388.482590:0:14466:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.130@tcp (ffff9e79fe918000) 00000020:00000080:1.0:1789635388.482607:0:14466:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789635388.482679:0:14466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79e73b2000@MGC192.168.201.130@tcp: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789635388.482832:0:14466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.130@tcp-0 is initialized 00000040:01000000:1.0:1789635388.482838:0:14466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789635388.483104:0:14480:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789635388.485527:0:14481:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789635388.485919:0:14466:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.130@tcp (uuid b8229a1b-c2b6-4ba8-903c-807c449e978b) 00000020:00000080:1.0:1789635388.485948:0:14466:0:(genops.c:1384:class_connect()) connect: client b8229a1b-c2b6-4ba8-903c-807c449e978b, cookie 0x77332204cfbb3d10 00000100:00080000:1.0:1789635388.485961:0:14466:0:(import.c:545:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635388.485974:0:14466:0:(import.c:666:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e79e73b2000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789635388.486014:0:14466:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fe906300 x1876568422036864/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789635388.486047:0:14466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b8229a1b-c2b6-4ba8-903c-807c449e978b->MGS 00000020:01000004:1.0:1789635388.486076:0:14466:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789635388.486083:0:14466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789635388.486096:0:14466:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e79fe91cd40) 00000020:00000080:1.0:1789635388.486107:0:14466:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789635388.486288:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8229a1b-c2b6-4ba8-903c-807c449e978b:3305:1876568422036864:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789635388.486395:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635388.486488:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422036864 00000100:00100000:2.0:1789635388.486496:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422036864 00000100:00100000:2.0:1789635388.486523:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635388.486530:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876568422036864:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789635388.486553:0:14476:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b8229a1b-c2b6-4ba8-903c-807c449e978b@0@lo t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:2.0:1789635388.486573:0:14476:0:(genops.c:1384:class_connect()) connect: client b8229a1b-c2b6-4ba8-903c-807c449e978b, cookie 0x77332204cfbb3d1e 00000100:00080000:2.0:1789635388.486725:0:14476:0:(import.c:65:import_set_state_nolock()) ffff9e79fdf26800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635388.486772:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+5:3305:x1876568422036864:12345-0@lo:250:mount.lustre.0 Request processed in 241us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635388.486780:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635388.486821:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789635388.486829:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:2.0:1789635388.486835:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789635388.486839:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789635388.486842:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79e73b2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789635388.486844:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789635388.486851:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789635388.486856:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b8229a1b-c2b6-4ba8-903c-807c449e978b:3305:1876568422036864:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789635388.517441:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635388.517659:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789635388.517666:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789635388.519980:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635388.519991:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789635388.522526:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789635388.522540:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789635388.525843:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635388.526045:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789635388.526051:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789635388.527844:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789635388.527854:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789635388.660511:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635388.660713:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789635388.660720:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789635388.664077:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789635388.664090:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789635388.664940:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635388.665120:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789635388.665125:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789635388.666248:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789635388.666256:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789635388.676223:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635388.676576:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789635388.676583:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789635388.678269:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789635388.678281:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789635388.679002:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635388.680016:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789635388.680024:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789635388.688892:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789635388.689648:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789635388.795247:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789635388.795486:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789635388.795495:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789635388.802657:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635388.802680:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789635388.821786:0:14466:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789635388.823353:0:14466:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789635388.825389:0:14466:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789635388.825414:0:14466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789635388.825420:0:14466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789635388.825570:0:14466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789635388.825605:0:14466:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789635388.825609:0:14466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789635388.825611:0:14466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789635388.825612:0:14466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635388.825613:0:14466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635388.825614:0:14466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635388.825615:0:14466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635388.825617:0:14466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635388.825618:0:14466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789635388.825620:0:14466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635388.825808:0:14466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789635388.825813:0:14466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789635388.825816:0:14466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635388.825817:0:14466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789635388.825818:0:14466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635388.825819:0:14466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635388.825820:0:14466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635388.825821:0:14466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635388.825828:0:14466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635388.825829:0:14466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789635388.825830:0:14466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635388.825831:0:14466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789635388.825934:0:14466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789635388.825955:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422036992:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789635388.826021:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635388.826076:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d102d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789635388.827795:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422036992 00000100:00100000:3.0:1789635388.827810:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422036992 00000100:00100000:3.0:1789635388.827866:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635388.827875:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+5:14466:x1876568422036992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789635388.827933:0:14479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789635388.827937:0:14479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789635388.827939:0:14479:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789635388.828988:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789635388.829505:0:14479:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789635388.832843:0:14501:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789635388.832852:0:14501:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789635388.832854:0:14501:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789635388.832888:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789635388.833242:0:14479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789635388.833254:0:14479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789635388.890890:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+5:14466:x1876568422036992:12345-0@lo:253:mount.lustre.0 Request processed in 63005us (64858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635388.890905:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635388.891048:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422036992:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789635388.891064:0:14466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789635388.891068:0:14466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789635388.891069:0:14466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789635388.891071:0:14466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635388.891072:0:14466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635388.891073:0:14466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635388.891074:0:14466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635388.891076:0:14466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635388.891077:0:14466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789635388.891079:0:14466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635388.891094:0:14466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789635388.891112:0:14466:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e79e734d800 from lustre-MDT0000 10000000:01000000:1.0:1789635388.891142:0:14466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789635388.891158:0:14466:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789635388.891163:0:14466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e79fe918000 10000000:01000000:1.0:1789635388.891167:0:14466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635388.891177:0:14466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e79fe918000 from 1 10000000:01000000:1.0:1789635388.891180:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789635388.891232:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635388.891244:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635388.891254:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635388.891273:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635388.891342:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635388.891726:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d102d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635388.891832:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422037120 00000100:00100000:3.0:1789635388.891839:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422037120 00000100:00100000:3.0:1789635388.891883:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635388.891893:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+5:14466:x1876568422037120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635388.891907:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635388.891924:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79e7c72c00/0x77332204cfbb3d2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3d25 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635388.891947:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c72c00/0x77332204cfbb3d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3d25 expref: 6 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635388.891958:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79e7c72c00/0x77332204cfbb3d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3d25 expref: 6 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635388.891967:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72c00, rc 0) 00000100:00100000:3.0:1789635388.892016:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+6:14466:x1876568422037120:12345-0@lo:101:mount.lustre.0 Request processed in 125us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635388.892023:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635388.896053:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635388.896082:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.896097:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635388.899781:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635388.899855:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635388.899903:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635388.900017:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422037248 00000100:00100000:3.0:1789635388.900025:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422037248 00000100:00100000:3.0:1789635388.900070:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635388.900080:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+6:14466:x1876568422037248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635388.900609:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+6:14466:x1876568422037248:12345-0@lo:501:mount.lustre.0 Request processed in 529us (752us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789635388.900618:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635388.900851:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037248:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789635388.900882:0:14466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789635388.900906:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.900917:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635388.900926:0:14466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e79e734d800 10000000:01000000:2.0:1789635388.900931:0:14466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789635388.900935:0:14466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e79e734d800 10000000:01000000:2.0:1789635388.900946:0:14466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789635388.900950:0:14466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e79e734d800 from 1 10000000:01000000:2.0:1789635388.900952:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789635388.900980:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820400/0x77332204cfbb3d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.900987:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe820400/0x77332204cfbb3d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.900996:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe820400/0x77332204cfbb3d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635388.901010:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789635388.901038:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635388.901111:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024240 going to sleep for 11 seconds 00000100:00100000:1.0:1789635388.908599:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422037376 00000100:00100000:1.0:1789635388.908616:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422037376 00000100:00100000:0.0:1789635388.911755:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635388.911769:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+6:14466:x1876568422037376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635388.911787:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635388.911808:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0031800/0x77332204cfbb3d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3d33 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635388.911835:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0031800/0x77332204cfbb3d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3d33 expref: 7 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635388.911847:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0031800/0x77332204cfbb3d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3d33 expref: 7 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635388.911857:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031800, rc 0) 00000100:00100000:0.0:1789635388.911937:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+7:14466:x1876568422037376:12345-0@lo:101:mount.lustre.0 Request processed in 171us (10898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635388.911944:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635388.912095:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635388.912114:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe820400/0x77332204cfbb3d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d3a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.912123:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820400/0x77332204cfbb3d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3d3a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635388.912141:0:14466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789635388.912173:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820400/0x77332204cfbb3d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d3a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.912182:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe820400/0x77332204cfbb3d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d3a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635388.912190:0:14466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789635388.912216:0:14466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635388.912222:0:14466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e79e734d800 10000000:01000000:2.0:1789635388.912225:0:14466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789635388.912229:0:14466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789635388.912232:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789635388.912255:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb3d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.912264:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb3d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.912273:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb3d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635388.912302:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789635388.912355:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635388.919392:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635388.923431:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422037504 00000100:00100000:3.0:1789635388.923449:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422037504 00000100:00100000:3.0:1789635388.923524:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635388.923534:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+7:14466:x1876568422037504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635388.923552:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635388.923572:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79e7c73e00/0x77332204cfbb3d48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3d41 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635388.923601:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c73e00/0x77332204cfbb3d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3d41 expref: 8 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635388.923614:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79e7c73e00/0x77332204cfbb3d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3d41 expref: 8 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635388.923634:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73e00, rc 0) 00000100:00100000:3.0:1789635388.923708:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+8:14466:x1876568422037504:12345-0@lo:101:mount.lustre.0 Request processed in 176us (11352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635388.923714:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635388.924022:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635388.924041:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb3d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d48 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635388.924051:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb3d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3d48 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635388.924120:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635388.924169:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635388.924723:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635388.924827:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422037632 00000100:00100000:3.0:1789635388.924833:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422037632 00000100:00100000:3.0:1789635388.924856:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635388.924863:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+8:14466:x1876568422037632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635388.925258:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14466:x1876568422037632:12345-0@lo:501:mount.lustre.0 Request processed in 394us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635388.925267:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635388.925567:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635388.925612:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635388.925666:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635388.925694:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635388.925857:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422037760 00000100:00100000:3.0:1789635388.925862:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422037760 00000100:00100000:3.0:1789635388.925882:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635388.925889:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14466:x1876568422037760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635388.926449:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14466:x1876568422037760:12345-0@lo:503:mount.lustre.0 Request processed in 559us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635388.926457:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635388.926613:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422037760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635388.927118:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14502:1876568422037888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635388.927170:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635388.927208:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c8b45600 going to sleep for 11 seconds 00000100:00100000:3.0:1789635388.927461:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422037888 00000100:00100000:3.0:1789635388.927479:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422037888 00000100:00100000:3.0:1789635388.927515:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635388.927523:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14502:x1876568422037888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789635388.927804:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14502:x1876568422037888:12345-0@lo:502:llog_process_th.0 Request processed in 282us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635388.927811:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635388.927964:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14502:1876568422037888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635388.927988:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635388.927999:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635388.928001:0:14502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789635388.928006:0:14502:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789635388.928009:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635388.928028:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e79f9193380) 00000020:00000080:0.0:1789635388.928044:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789635388.928051:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789635388.928119:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789635388.928127:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb3d56 00000020:00000080:0.0:1789635388.928566:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789635388.928571:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635388.928575:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635388.928576:0:14502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789635388.928579:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635388.928583:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635388.928584:0:14502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789635388.928587:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635388.928594:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e79f9194d40) 00000020:00000080:0.0:1789635388.928604:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789635388.928607:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789635388.928609:0:14502:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789635388.928612:0:14502:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789635388.928617:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789635388.928745:0:14502:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79e734d800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789635388.928758:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e79f9190000) 00000020:00000080:0.0:1789635388.928768:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789635388.928808:0:14502:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789635388.928813:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb3d6b 00000020:00000080:0.0:1789635388.928906:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789635388.928911:0:14502:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789635388.928916:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x77332204cfbb3d72 00080000:01000000:0.0:1789635388.928921:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789635388.928925:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb3d79 00010000:00010000:3.0:1789635389.147123:0:14502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789635389.148246:0:14502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789635389.148638:0:14502:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789635389.161754:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e79f91919c0) 00000020:00000080:0.0:1789635389.161777:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789635389.161857:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789635389.161870:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb3d87 00000020:00000080:1.0:1789635389.165475:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789635389.181777:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x77332204cfbb3d8e 00000020:00000080:1.0:1789635389.182373:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789635389.182386:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635389.182394:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.182397:0:14502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789635389.182401:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635389.182407:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.182408:0:14502:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789635389.182426:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789635389.182486:0:14502:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789635389.182506:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635389.182509:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.182510:0:14502:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789635389.182513:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789635389.182516:0:14502:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789635389.182518:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789635389.182519:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789635389.182521:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789635389.182523:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.182525:0:14502:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789635389.182527:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789635389.182531:0:14502:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789635389.182535:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.182536:0:14502:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789635389.182539:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789635389.182544:0:14502:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1789635389.182573:0:14502:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789635389.182576:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789635389.182594:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e79fe91b380) 00000020:00000080:1.0:1789635389.182610:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789635389.182615:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789635389.182680:0:14502:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789635389.182686:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789635389.182692:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb3d9c 00010000:00080000:1.0:1789635389.182730:0:14502:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79e73b0800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789635389.182982:0:14502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789635389.185030:0:14502:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789635389.185084:0:14502:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789635389.199382:0:14502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635389.199758:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789635389.199841:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789635389.200953:0:14506:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789635389.200969:0:14506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789635389.202141:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789635389.202157:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789635389.202191:0:14502:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789635389.202209:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb3da3 00000100:00080000:2.0:1789635389.202219:0:14502:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789635389.202232:0:14502:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e79e73b0800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635389.202270:0:14502:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e78c1381f80 x1876568422038016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635389.202299:0:14502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789635389.202702:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635389.202707:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635389.202709:0:14502:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789635389.202712:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789635389.202715:0:14502:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1789635389.202716:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635389.202718:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789635389.202719:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789635389.202722:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635389.202723:0:14502:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789635389.202725:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789635389.202730:0:14502:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789635389.202732:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635389.202734:0:14502:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789635389.202737:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789635389.202740:0:14502:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:2.0:1789635389.202768:0:14502:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789635389.202771:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635389.202783:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e79e76a4d40) 00000020:00000080:2.0:1789635389.202795:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789635389.202800:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789635389.202856:0:14502:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789635389.202862:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789635389.202867:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x77332204cfbb3db1 00010000:00080000:2.0:1789635389.202892:0:14502:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79dc2fd000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789635389.203116:0:14502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789635389.203275:0:14502:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789635389.203294:0:14502:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789635389.203818:0:14502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635389.203877:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789635389.203959:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1789635389.204681:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422038016:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789635389.204744:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568422038016 offset 0 length 520: 4 00000100:00100000:1.0:1789635389.205106:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635389.205117:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422038144:0@lo:400:kworker.0 00000100:00100000:1.0:1789635389.205170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635389.205665:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422038144 00000100:00100000:3.0:1789635389.205676:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422038144 00000100:00100000:3.0:1789635389.205726:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789635389.205744:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:3306:x1876568422038144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635389.205814:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:3306:x1876568422038144:12345-0@lo:400:kworker.0 Request processed in 72us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.205821:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635389.205909:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422038144:0@lo:400:kworker.0 00000040:00080000:0.0:1789635389.207916:0:14508:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789635389.207924:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789635389.209697:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789635389.209711:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789635389.209745:0:14502:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789635389.209764:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb3db8 00000100:00080000:2.0:1789635389.209775:0:14502:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789635389.210261:0:14502:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79dc2fd000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635389.210303:0:14502:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e78c1382680 x1876568422038272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635389.210359:0:14502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789635389.210578:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635389.210584:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635389.210586:0:14502:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789635389.210589:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635389.210593:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635389.210594:0:14502:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789635389.210604:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789635389.210606:0:14502:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789635389.210609:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635389.210611:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635389.210612:0:14502:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789635389.210615:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635389.210617:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635389.210618:0:14502:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789635389.210622:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789635389.210653:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14502:1876568422038400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635389.210730:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.210800:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da024540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635389.210874:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422038272:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789635389.210925:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568422038272 offset 0 length 520: 4 00000100:00100000:1.0:1789635389.214752:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422038400 00000100:00100000:1.0:1789635389.214768:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422038400 00000100:00100000:1.0:1789635389.214837:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635389.214848:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14502:x1876568422038400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635389.216088:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14502:x1876568422038400:12345-0@lo:502:llog_process_th.0 Request processed in 1239us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.216099:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635389.217379:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14502:1876568422038400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635389.217433:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635389.217442:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.217444:0:14502:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789635389.217449:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789635389.217640:0:14466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789635389.217659:0:14466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789635389.217687:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb3d41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d48 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.217699:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe820e00/0x77332204cfbb3d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d48 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635389.217708:0:14466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79e734d800 from 1 10000000:01000000:3.0:1789635389.217711:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789635389.217752:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.217761:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.217771:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635389.217790:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635389.217839:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635389.217887:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f91c6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635389.218271:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422038528 00000100:00100000:0.0:1789635389.218279:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422038528 00000100:00100000:0.0:1789635389.218368:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789635389.218378:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+9:14466:x1876568422038528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635389.218392:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635389.218406:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3dbf expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.218429:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 10 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.218440:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 10 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.218448:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0031a00, rc 0) 00000100:00100000:0.0:1789635389.218500:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+10:14466:x1876568422038528:12345-0@lo:101:mount.lustre.0 Request processed in 124us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635389.218507:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635389.218890:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635389.218915:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.218925:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635389.219890:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038656:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789635389.219952:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.219997:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da0246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635389.220339:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422038656 00000100:00100000:0.0:1789635389.220347:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422038656 00000100:00100000:0.0:1789635389.220391:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789635389.220400:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+10:14466:x1876568422038656:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789635389.220437:0:14478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789635389.220443:0:14478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789635389.220540:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+10:14466:x1876568422038656:12345-0@lo:256:mount.lustre.0 Request processed in 140us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635389.220548:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635389.235258:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038656:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789635389.237716:0:14466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789635389.237736:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.237765:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635389.237775:0:14466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79e734d800 from 1 10000000:01000000:2.0:1789635389.237778:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789635389.237822:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.237829:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.237841:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635389.237865:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789635389.237937:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.237996:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da0246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635389.239590:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422038784 00000100:00100000:3.0:1789635389.239602:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422038784 00000100:00100000:3.0:1789635389.239656:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789635389.239678:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+10:14466:x1876568422038784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635389.239695:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635389.239715:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3dcd expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.239741:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.239752:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.239761:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72e00, rc 0) 00000100:00100000:3.0:1789635389.239825:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14466:x1876568422038784:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.239832:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635389.241875:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635389.241914:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.241927:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635389.243915:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635389.243992:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.245126:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da0246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635389.246181:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422038912 00000100:00100000:3.0:1789635389.246193:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422038912 00000100:00100000:3.0:1789635389.246242:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635389.246252:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14466:x1876568422038912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635389.246699:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14466:x1876568422038912:12345-0@lo:501:mount.lustre.0 Request processed in 448us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.246707:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789635389.249542:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422038912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635389.249602:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635389.249670:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.249713:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79da0246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635389.251981:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039040 00000100:00100000:0.0:1789635389.251996:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039040 00000100:00100000:0.0:1789635389.252060:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635389.252070:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14466:x1876568422039040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635389.252341:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14466:x1876568422039040:12345-0@lo:503:mount.lustre.0 Request processed in 271us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635389.252349:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789635389.255017:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635389.256542:0:14510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14510:1876568422039168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635389.256620:0:14510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.256664:0:14510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c70f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635389.256772:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039168 00000100:00100000:2.0:1789635389.256779:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039168 00000100:00100000:2.0:1789635389.256814:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789635389.256821:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14510:x1876568422039168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635389.257111:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14510:x1876568422039168:12345-0@lo:502:llog_process_th.0 Request processed in 288us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.257118:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789635389.257410:0:14510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14510:1876568422039168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789635389.257438:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635389.257448:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.257450:0:14510:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789635389.257456:0:14510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79e734d800 00000020:00000080:1.0:1789635389.257459:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635389.257599:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635389.257603:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.257605:0:14510:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789635389.257615:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635389.257617:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.257619:0:14510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789635389.257623:0:14510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79e734d800 00000020:00000080:1.0:1789635389.257625:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789635389.257733:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635389.257738:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.257739:0:14510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789635389.257742:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635389.257744:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635389.257745:0:14510:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789635389.257748:0:14510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e79e734d800 00000020:00000080:1.0:1789635389.257751:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789635389.264646:0:14510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14510:1876568422039296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635389.264728:0:14510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.264776:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039296 00000100:00100000:1.0:1789635389.264784:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039296 00000100:00100000:1.0:1789635389.264835:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789635389.264844:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14510:x1876568422039296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789635389.265152:0:14510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c70f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635389.266365:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14510:x1876568422039296:12345-0@lo:502:llog_process_th.0 Request processed in 1518us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635389.266377:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789635389.279074:0:14510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14510:1876568422039296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789635389.279148:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635389.279158:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635389.279160:0:14510:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789635389.279166:0:14510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789635389.279868:0:14466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789635389.279887:0:14466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789635389.279911:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.279923:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635389.280074:0:14466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789635389.280078:0:14466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e79e734d800 10000000:01000000:2.0:1789635389.280081:0:14466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e79e734d800 10000000:01000000:2.0:1789635389.280085:0:14466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635389.280090:0:14466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79e734d800 from 1 10000000:01000000:2.0:1789635389.280093:0:14466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789635389.280130:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821c00/0x77332204cfbb3ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.281113:0:14466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe821c00/0x77332204cfbb3ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.281126:0:14466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe821c00/0x77332204cfbb3ddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635389.281402:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789635389.281700:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.281750:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635389.281996:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039424 00000100:00100000:1.0:1789635389.282014:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039424 00000100:00100000:1.0:1789635389.282063:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635389.282072:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14466:x1876568422039424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635389.282086:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635389.282104:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb3de2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3ddb expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.282142:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb3de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3ddb expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.282167:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85a00/0x77332204cfbb3de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3ddb expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.282176:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85a00, rc 0) 00000100:00100000:1.0:1789635389.283608:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14466:x1876568422039424:12345-0@lo:101:mount.lustre.0 Request processed in 1529us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635389.283620:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789635389.283802:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635389.283825:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe821c00/0x77332204cfbb3ddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3de2 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.283836:0:14466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe821c00/0x77332204cfbb3ddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3de2 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635389.283910:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635389.283944:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.283988:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635389.284294:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039552 00000100:00100000:1.0:1789635389.284303:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039552 00000100:00100000:1.0:1789635389.284361:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635389.284369:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14466:x1876568422039552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635389.285777:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14466:x1876568422039552:12345-0@lo:501:mount.lustre.0 Request processed in 1404us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635389.285787:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635389.285896:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635389.285934:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635389.285984:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.286691:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1789635389.287191:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039680 00000100:00100000:1.0:1789635389.287252:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039680 00000100:00100000:1.0:1789635389.287593:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789635389.287603:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14466:x1876568422039680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635389.287772:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14466:x1876568422039680:12345-0@lo:503:mount.lustre.0 Request processed in 171us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635389.287779:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789635389.288588:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422039680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635389.291331:0:14515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14515:1876568422039808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789635389.293338:0:14515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635389.293693:0:14515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c70f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635389.299168:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039808 00000100:00100000:2.0:1789635389.299190:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039808 00000100:00100000:2.0:1789635389.299249:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789635389.299261:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14515:x1876568422039808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635389.299572:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14515:x1876568422039808:12345-0@lo:502:llog_process_th.0 Request processed in 313us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.299581:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789635389.306925:0:14515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14515:1876568422039808:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789635389.307010:0:14515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789635389.307027:0:14515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e79c61999c0) 00000020:00000080:0.0:1789635389.308421:0:14515:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789635389.308612:0:14515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79e734d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789635389.308618:0:14515:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79e734d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789635389.308621:0:14515:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79e734d800 4 00010000:00080000:3.0:1789635389.308650:0:14515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79c8b09800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1789635389.323267:0:14515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789635389.325156:0:14515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789635389.325204:0:14515:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789635389.325217:0:14515:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x77332204cfbb3df0 00000100:00080000:3.0:1789635389.325239:0:14515:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789635389.325252:0:14515:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e79c8b09800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635389.327019:0:14515:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79e7eff800 x1876568422039936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635389.327047:0:14515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789635389.329275:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568422039936:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789635389.329387:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.332020:0:14515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14515:1876568422040064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635389.332104:0:14515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.332155:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040064 00000100:00100000:2.0:1789635389.332165:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040064 00000100:00100000:2.0:1789635389.332516:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635389.332527:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14515:x1876568422040064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789635389.332767:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14515:x1876568422040064:12345-0@lo:502:llog_process_th.0 Request processed in 242us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.332775:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789635389.332826:0:14515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad240 going to sleep for 11 seconds 00000100:00100000:2.0:1789635389.332847:0:14515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8229a1b-c2b6-4ba8-903c-807c449e978b:14515:1876568422040064:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789635389.332874:0:14515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789635389.333489:0:14466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789635389.333512:0:14466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789635389.333533:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821c00/0x77332204cfbb3ddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3de2 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.333546:0:14466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe821c00/0x77332204cfbb3ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3de2 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789635389.333595:0:14466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789635389.333598:0:14466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789635389.333599:0:14466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635389.333600:0:14466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635389.333601:0:14466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635389.333603:0:14466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635389.333604:0:14466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635389.333606:0:14466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789635389.333608:0:14466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635389.333609:0:14466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635389.333612:0:14466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789635389.333615:0:14466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789635389.333616:0:14466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789635389.333617:0:14466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789635389.333618:0:14466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789635389.333619:0:14466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789635389.333620:0:14466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789635389.333621:0:14466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789635389.333622:0:14466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789635389.333624:0:14466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789635389.333624:0:14466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789635389.333642:0:14466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789635389.333654:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422040192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789635389.333704:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.333731:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c70f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635389.339377:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422039936 00000100:00100000:3.0:1789635389.339394:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422039936 00000100:00100000:3.0:1789635389.339439:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635389.339449:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876568422039936:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789635389.339560:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876568422039936:12345-0@lo:38:llog_process_th.0 Request processed in 111us (10173us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789635389.339567:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635389.339905:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789635389.339914:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79c8b09800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635389.339919:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789635389.339923:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568422039936:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789635389.340734:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040192 00000100:00100000:1.0:1789635389.340744:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040192 00000100:00100000:1.0:1789635389.340792:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789635389.340801:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14466:x1876568422040192:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789635389.340855:0:14476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789635389.340871:0:14476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1789635389.467855:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1789635389.486700:0:14476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789635389.486821:0:14476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789635389.491593:0:14500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789635389.491609:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789635389.491642:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.491666:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.491677:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.492036:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.492056:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 12 pid: 14476 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635389.492098:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876568422040320:0@lo:104: 00000100:00100000:3.0:1789635389.492179:0:14500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635389.492253:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79f9120840 going to sleep for 11 seconds 00000100:00100000:0.0:1789635389.494036:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040320 00000100:00100000:0.0:1789635389.494054:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040320 00000100:00100000:0.0:1789635389.494133:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635389.494160:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14500:x1876568422040320:12345-0@lo:104: 00010000:00010000:0.0:1789635389.494180:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.494376:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789635389.494384:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14500:x1876568422040320:12345-0@lo:104: Request processed in 227us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635389.494391:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789635389.494421:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635389.494428:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.494436:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72800 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:0.0:1789635389.494442:0:14472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.494451:0:14472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789635389.494470:0:14472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635389.494476:0:14472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789635389.494659:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876568422040320:0@lo:104: 00010000:00010000:3.0:1789635389.494693:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.497956:0:14472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.497979:0:14472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789635389.498020:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.498052:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72800/0x77332204cfbb3dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3dc6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.498084:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635389.498087:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635389.498089:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635389.498149:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422040448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789635389.498232:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635389.501929:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040448 00000100:00100000:1.0:1789635389.501952:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040448 00010000:00010000:1.0:1789635389.502007:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 13 pid: 14476 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635389.502064:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635389.502075:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+13:3308:x1876568422040448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635389.502094:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635389.502102:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 13 pid: 14476 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502117:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 13 pid: 14476 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502139:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0031a00/0x77332204cfbb3dc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb3dbf expref: 13 pid: 14476 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502183:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502193:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635389.502215:0:14469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010607789s 00010000:00010000:1.0:1789635389.502221:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502229:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502236:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502244:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.502250:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635389.502255:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.504923:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.504991:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635389.505015:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635389.505153:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:3308:x1876568422040448:12345-0@lo:103:ldlm_bl.0 Request processed in 3076us (6917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635389.505165:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635389.506945:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422040448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635389.506999:0:14500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.507014:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635389.507022:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79e7c72400/0x77332204cfbb3df7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635389.522441:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14466:x1876568422040192:12345-0@lo:253:mount.lustre.0 Request processed in 181627us (188723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635389.522469:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635389.522667:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:14466:1876568422040192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789635389.522685:0:14466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789635389.522689:0:14466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789635389.522690:0:14466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789635389.522692:0:14466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635389.522693:0:14466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635389.522694:0:14466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635389.522696:0:14466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635389.522697:0:14466:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789635389.522699:0:14466:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789635389.522700:0:14466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635389.522731:0:14466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789635389.522750:0:14466:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789635389.532570:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635389.532811:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789635389.533139:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635389.533298:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789635389.533634:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635389.534505:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789635389.540423:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789635389.540625:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789635389.540912:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789635389.541149:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789635389.541513:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789635389.541668:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789635389.629843:0:14466:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789635389.630941:0:14466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789635389.631137:0:14521:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789635389.631141:0:14521:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789635389.631422:0:14522:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789635389.631515:0:14522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635389.637131:0:14522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789635389.637536:0:14522:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789635389.637542:0:14522:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789635389.637799:0:14466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789635389.637955:0:14466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789635389.638608:0:14466:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789635389.638617:0:14466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789635389.638751:0:14466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635389.640067:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789635389.643915:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789635389.644007:0:14466:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789635389.647046:0:14466:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789635389.677864:0:14466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789635389.759425:0:14466:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789635389.759477:0:14466:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc31401c7b988 00100000:10000000:3.0:1789635389.759485:0:14466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789635389.760527:0:14466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789635389.760546:0:14466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789635389.760560:0:14466:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789635389.760580:0:14466:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:2.0:1789635389.814256:0:14481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789635389.814265:0:14481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79e734d800 from 6 10000000:01000000:2.0:1789635389.814270:0:14481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789635389.814356:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.814369:0:14481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.814381:0:14481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635389.814407:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422040576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789635389.814493:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.814543:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1789635389.814567:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040576 00000100:00100000:2.0:1789635389.814574:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040576 00000100:00100000:2.0:1789635389.814641:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635389.814651:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14481:x1876568422040576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635389.814664:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635389.814680:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3dfe expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.814704:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.814715:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.814725:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821600, rc 0) 00000100:00100000:2.0:1789635389.814764:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422040576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635389.814771:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789635389.814821:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422040576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635389.814836:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635389.814845:0:14481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635389.814893:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422040704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789635389.814921:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635389.814943:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1789635389.815208:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040704 00000100:00100000:3.0:1789635389.815215:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040704 00000100:00100000:3.0:1789635389.815247:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635389.815255:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422040704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789635389.815270:0:14478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789635389.815286:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789635389.815288:0:14478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789635389.815393:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422040704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635389.815401:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789635389.815432:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422040704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789635389.817784:0:14481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789635389.817800:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635389.817812:0:14481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635390.363544:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789635390.483502:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635391.382197:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789635391.507724:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635392.532066:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635393.558608:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635394.582957:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789635394.836295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635394.836304:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635394.836308:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635394.836336:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635394.836338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789635394.836342:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789635394.836346:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e79c8b09800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789635394.836374:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e79c8b09800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789635394.836400:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79dba5dc00 x1876568422040960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635394.836441:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8229a1b-c2b6-4ba8-903c-807c449e978b:3309:1876568422040832:0@lo:400:kworker.0 00000100:00100000:0.0:1789635394.836529:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635394.836901:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040832 00000100:00100000:3.0:1789635394.836912:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040832 00000100:00100000:0.0:1789635394.836982:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568422040960:0@lo:38:kworker.0 00000100:00100000:0.0:1789635394.837019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635394.839765:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422040960 00000100:00100000:1.0:1789635394.839783:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422040960 00000100:00100000:1.0:1789635394.839827:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635394.839836:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876568422040960:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789635394.839880:0:14486:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:1.0:1789635394.839925:0:14486:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x77332204cfbb3e0c 00000004:00100000:1.0:1789635394.839943:0:14486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789635394.840080:0:14486:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5f9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635394.840181:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876568422040960:12345-0@lo:38:kworker.0 Request processed in 344us (3159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635394.840189:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789635394.840306:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e79dba5dc00 x1876568422040960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789635394.840342:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789635394.840351:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789635394.840356:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789635394.840358:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79c8b09800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789635394.840377:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876568422040960:0@lo:38:kworker.0 00000100:00100000:3.0:1789635394.841804:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635394.841822:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:3309:x1876568422040832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635394.841905:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:3309:x1876568422040832:12345-0@lo:400:kworker.0 Request processed in 88us (5375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635394.841912:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789635394.841969:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8229a1b-c2b6-4ba8-903c-807c449e978b:3309:1876568422040832:0@lo:400:kworker.0 00000001:02000400:0.0:1789635395.045439:0:14766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789635395.605111:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635396.627788:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635397.651965:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789635398.631927:0:14916:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe357b00e0 20000000:00000080:3.0:1789635398.631947:0:14916:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e79ddacd000 uarg=0000000000000000 20000000:01000000:3.0:1789635398.631976:0:14916:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789635398.631982:0:14916:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789635398.631987:0:14916:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789635398.634891:0:14917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789635398.635067:0:14916:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789635398.644003:0:14916:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789635398.644040:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635398.644062:0:14916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635398.644073:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635398.644278:0:14916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635398.644307:0:14916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 11 pid: 14479 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635398.644607:0:14916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14916:1876568422041088:0@lo:104: 00000100:00100000:3.0:1789635398.644679:0:14916:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635398.644741:0:14916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c3f266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635398.644844:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422041088 00000100:00100000:1.0:1789635398.644854:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422041088 00000100:00100000:1.0:1789635398.644908:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635398.644919:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14916:x1876568422041088:12345-0@lo:104: 00010000:00010000:1.0:1789635398.644933:0:14468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.644999:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789635398.645006:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14916:x1876568422041088:12345-0@lo:104: Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635398.645030:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789635398.645056:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635398.645063:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645071:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635398.645075:0:14473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645084:0:14473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635398.645113:0:14473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635398.645119:0:14473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789635398.645156:0:14473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645163:0:14473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635398.645183:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645189:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79fe820c00/0x77332204cfbb3dcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3dd4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645205:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635398.645207:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635398.645209:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635398.645228:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422041216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635398.645274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635398.645347:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422041216 00000100:00100000:1.0:1789635398.645352:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422041216 00010000:00010000:1.0:1789635398.645373:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 12 pid: 14479 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635398.645397:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635398.645404:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:3306:x1876568422041216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635398.645416:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635398.645421:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 12 pid: 14479 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645432:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 12 pid: 14479 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645449:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645458:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645474:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645482:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645489:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645495:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.645507:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635398.645675:0:14916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79e7c72e00/0x77332204cfbb3dd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb3dcd expref: 12 pid: 14479 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635398.645688:0:14916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14916:1876568422041088:0@lo:104: 00010000:00010000:0.0:1789635398.645720:0:14916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635398.645732:0:14916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635398.645739:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.646879:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.646894:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.646908:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.646916:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79e7c72000/0x77332204cfbb3e13 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635398.646931:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635398.646998:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:3306:x1876568422041216:12345-0@lo:103:ldlm_bl.0 Request processed in 1593us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635398.647007:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635398.649099:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422041216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635398.676497:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635399.720111:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635399.956089:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635389/real 1789635389] req@ffff9e78c1382680 x1876568422038272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635399 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635399.956122:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e78c1382680 x1876568422038272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635399 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635399.956134:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635389/real 1789635389] req@ffff9e78c1381f80 x1876568422038016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635399 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635399.956146:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e78c1381f80 x1876568422038016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635399 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635399.956166:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635399.956174:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635399.956177:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422038272:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789635399.956182:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79e73b0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635399.956186:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635399.956188:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422038016:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789635399.962245:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635399.962252:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789635399.962257:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79e73b0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635399.962265:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 365 00000100:00080000:2.0:1789635399.962282:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789635399.962295:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e79e73b0800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635399.962339:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e78c1382a00 x1876568422041472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789635399.962355:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635399.962358:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789635399.962359:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635399.962362:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 365 00000100:00080000:2.0:1789635399.962364:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789635399.962369:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79dc2fd000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635399.962389:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e78c1380380 x1876568422041600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635399.962432:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635399.962446:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422041344:0@lo:400:kworker.0 00000100:00100000:2.0:1789635399.962515:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635399.962569:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422041472:0@lo:8:kworker.0 00000400:00000100:2.0:1789635399.962594:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568422041472 offset 0 length 520: 4 00000100:00100000:2.0:1789635399.962607:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422041600:0@lo:8:kworker.0 00000400:00000100:2.0:1789635399.962624:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876568422041600 offset 0 length 520: 4 00000100:00100000:2.0:1789635399.962644:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422041728:0@lo:400:kworker.0 00000100:00100000:2.0:1789635399.962685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635399.962723:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422041344 00000100:00100000:2.0:1789635399.962731:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422041344 00000100:00100000:2.0:1789635399.962775:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635399.962784:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:3306:x1876568422041344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635399.962833:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:3306:x1876568422041344:12345-0@lo:400:kworker.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635399.962841:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635399.962883:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422041728 00000100:00100000:2.0:1789635399.965100:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422041728 00000100:00100000:2.0:1789635399.965165:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635399.965174:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422041728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635399.965259:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422041728:12345-0@lo:400:kworker.0 Request processed in 86us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635399.965265:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635399.965353:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422041344:0@lo:400:kworker.0 00010000:00080000:3.0:1789635399.966016:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e78c1380000 x1876568422041728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635399.966032:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422041728:0@lo:400:kworker.0 10000000:01000000:1.0:1789635400.147409:0:14481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789635400.147418:0:14481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79e734d800 from 10 10000000:01000000:1.0:1789635400.147424:0:14481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789635400.147482:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635400.147507:0:14481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635400.147520:0:14481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635400.147570:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422041856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635400.147645:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635400.147706:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7364780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635400.147765:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422041856 00000100:00100000:3.0:1789635400.147773:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422041856 00000100:00100000:3.0:1789635400.147826:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789635400.147842:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+11:14481:x1876568422041856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635400.147856:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635400.147873:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3e1a expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635400.147905:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635400.147916:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635400.147925:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c73600, rc 0) 00000100:00100000:3.0:1789635400.147977:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422041856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.147984:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789635400.148198:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422041856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635400.148213:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635400.148223:0:14481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635400.148289:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422041984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635400.148346:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635400.148368:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c7364780 going to sleep for 11 seconds 00000100:00100000:3.0:1789635400.148429:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422041984 00000100:00100000:3.0:1789635400.148434:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422041984 00000100:00100000:3.0:1789635400.148458:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635400.148466:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422041984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635400.148730:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422041984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.148737:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789635400.148769:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422041984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635400.148800:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422042112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635400.148835:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635400.148849:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e7a021496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635400.148859:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422042112 00000100:00100000:3.0:1789635400.148862:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422042112 00000100:00100000:3.0:1789635400.148883:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635400.148889:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422042112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635400.149030:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:14481:x1876568422042112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635400.149036:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789635400.149073:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422042112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789635400.150008:0:14978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789635400.150333:0:14481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789635400.150352:0:14481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789635400.150361:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635400.150374:0:14481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635400.724513:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789635401.620950:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789635401.751557:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635402.771610:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635403.795666:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789635404.664960:0:15166:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789635404.664965:0:15166:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789635404.665097:0:15166:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e79c8381000 00000020:01000004:2.0:1789635404.665565:0:15166:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789635404.665582:0:15166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789635404.665602:0:15166:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e79e76a0000) 00000020:00000080:2.0:1789635404.665626:0:15166:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789635404.690033:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789635404.690769:0:15166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789635404.692084:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789635404.692852:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789635404.693102:0:15166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789635404.693787:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789635404.693878:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789635404.693983:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789635404.694886:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 367: rc = 0 00100000:10000000:2.0:1789635404.695729:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 367: rc = 0 00100000:10000000:2.0:1789635404.695997:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 367: rc = 0 00100000:10000000:2.0:1789635404.696712:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 367: rc = 0 00100000:10000000:2.0:1789635404.696977:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 367: rc = 0 00100000:10000000:2.0:1789635404.697605:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 367: rc = 0 00000020:00000080:2.0:1789635404.698807:0:15166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789635404.698824:0:15166:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789635404.698836:0:15166:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x77332204cfbb3e2f 00000020:01000004:2.0:1789635404.698846:0:15166:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789635404.698871:0:15166:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789635404.698882:0:15166:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789635404.698888:0:15166:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789635404.698894:0:15166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789635404.698920:0:15166:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e79e7b28000) 00000020:00000080:2.0:1789635404.698933:0:15166:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789635404.700683:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635404.701002:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789635404.701010:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789635404.709890:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789635404.709914:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789635404.710628:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789635404.710636:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789635404.712596:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635404.712814:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789635404.712821:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789635404.713829:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789635404.713841:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789635404.762501:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789635404.762745:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789635404.762752:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789635404.764046:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789635404.764057:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789635404.773493:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789635404.773514:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789635404.780180:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789635404.780986:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789635404.780993:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789635404.785423:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789635404.785446:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1789635404.821237:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635404.882596:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789635404.882807:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789635404.882815:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789635404.886514:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789635404.886530:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789635404.887107:0:15166:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789635404.887150:0:15166:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789635404.887157:0:15166:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789635404.913654:0:15166:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789635404.913693:0:15166:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789635404.913702:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789635404.913703:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635404.913704:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635404.913706:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635404.913707:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635404.913708:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635404.913709:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635404.913711:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635404.913713:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635404.913716:0:15166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789635404.913718:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789635404.913719:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635404.913720:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635404.913721:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635404.913722:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635404.913723:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635404.913723:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635404.913724:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635404.913725:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789635404.913754:0:15166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789635404.913775:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042240:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789635404.913852:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635404.914047:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c12ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635404.914098:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422042240 00000100:00100000:0.0:1789635404.914112:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422042240 00000100:00100000:0.0:1789635404.914300:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789635404.914406:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:15166:x1876568422042240:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789635404.914446:0:14478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789635404.914450:0:14478:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789635404.914454:0:14478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789635404.920927:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:15166:x1876568422042240:12345-0@lo:253:mount.lustre.0 Request processed in 6607us (7063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635404.920943:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789635404.921044:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042240:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789635404.921062:0:15166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789635404.921066:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789635404.921068:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789635404.921069:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789635404.921070:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789635404.921071:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789635404.921073:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789635404.921074:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789635404.921076:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789635404.921077:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635404.921097:0:15166:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e79c8381000 from lustre-OST0000 10000000:01000000:3.0:1789635404.921646:0:15166:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789635404.921651:0:15166:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789635404.921673:0:15166:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e79fe918000 local copy 00010000:00010000:3.0:1789635404.921684:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635404.921931:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635404.921978:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635404.922023:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635404.922093:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422042368 00000100:00100000:0.0:1789635404.922101:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422042368 00000100:00100000:0.0:1789635404.922219:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789635404.922231:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:15166:x1876568422042368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635404.922696:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:15166:x1876568422042368:12345-0@lo:501:mount.lustre.0 Request processed in 466us (716us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635404.922704:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635404.922772:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042368:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789635404.922798:0:15166:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789635404.922944:0:15166:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789635404.922952:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.922962:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635404.922987:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e79c8381000 10000000:01000000:3.0:1789635404.922992:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789635404.922997:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e79fe918000 10000000:01000000:3.0:1789635404.923000:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789635404.923004:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e79fe918000 from 1 10000000:01000000:3.0:1789635404.923008:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789635404.923040:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72600/0x77332204cfbb3e3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.923048:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72600/0x77332204cfbb3e3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.923058:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72600/0x77332204cfbb3e3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635404.923081:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635404.923113:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635404.923249:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789635404.923298:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422042496 00000100:00100000:0.0:1789635404.923304:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422042496 00000100:00100000:0.0:1789635404.923661:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789635404.923671:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+12:15166:x1876568422042496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635404.923687:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635404.923707:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0030400/0x77332204cfbb3e44 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3e3d expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.923731:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030400/0x77332204cfbb3e44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3e3d expref: 13 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.923742:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0030400/0x77332204cfbb3e44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e3d expref: 13 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635404.923759:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030400, rc 0) 00000100:00100000:0.0:1789635404.923805:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+13:15166:x1876568422042496:12345-0@lo:101:mount.lustre.0 Request processed in 136us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635404.923811:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789635404.923889:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635404.923903:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72600/0x77332204cfbb3e3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e44 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.923912:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72600/0x77332204cfbb3e3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3e44 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635404.923929:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789635404.923947:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72600/0x77332204cfbb3e3d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e44 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.923955:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79e7c72600/0x77332204cfbb3e3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e44 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789635404.923962:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789635404.923967:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789635404.923971:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789635404.923973:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789635404.924001:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821a00/0x77332204cfbb3e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.924009:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79fe821a00/0x77332204cfbb3e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.924016:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79fe821a00/0x77332204cfbb3e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635404.924030:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789635404.924058:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635404.924346:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c4f35540 going to sleep for 11 seconds 00000100:00100000:3.0:1789635404.924417:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422042624 00000100:00100000:3.0:1789635404.924424:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422042624 00000100:00100000:3.0:1789635404.924449:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789635404.924455:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+13:15166:x1876568422042624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635404.924462:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635404.924473:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79e7c72200/0x77332204cfbb3e52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3e4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.924489:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79e7c72200/0x77332204cfbb3e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3e4b expref: 14 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.924497:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79e7c72200/0x77332204cfbb3e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e4b expref: 14 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.924503:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79e7c72200, rc 0) 00000100:00100000:3.0:1789635404.924546:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422042624:12345-0@lo:101:mount.lustre.0 Request processed in 91us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635404.924553:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789635404.924758:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635404.924769:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79fe821a00/0x77332204cfbb3e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e52 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.924777:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79fe821a00/0x77332204cfbb3e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3e52 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635404.925768:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789635404.926860:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635404.927108:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789635404.927153:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789635404.927202:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789635404.927253:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789635404.927308:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789635404.927536:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789635404.927622:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789635404.927631:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789635404.927719:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635404.927791:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635404.927900:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c4f35900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635404.927971:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422042752 00000100:00100000:0.0:1789635404.927981:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422042752 00000100:00100000:3.0:1789635404.928199:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789635404.928211:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422042752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635404.928755:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422042752:12345-0@lo:501:mount.lustre.0 Request processed in 546us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635404.928765:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789635404.928982:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635404.929016:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635404.929058:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635404.930588:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c4f35900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635404.930675:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422042880 00000100:00100000:3.0:1789635404.930684:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422042880 00000100:00100000:3.0:1789635404.930775:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789635404.930785:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422042880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635404.931228:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422042880:12345-0@lo:503:mount.lustre.0 Request processed in 443us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635404.931237:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789635404.931615:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422042880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789635404.936303:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789635404.936631:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635404.936728:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635404.936775:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c167ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789635404.936839:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043008 00000100:00100000:0.0:1789635404.936848:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043008 00000100:00100000:0.0:1789635404.936901:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789635404.936912:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422043008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635404.937161:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422043008:12345-0@lo:502:mount.lustre.0 Request processed in 250us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635404.937169:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789635404.937570:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635404.937825:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789635404.937873:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789635404.937903:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789635404.937960:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789635404.937997:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789635404.938027:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789635404.938064:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789635404.938096:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789635404.938144:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789635404.938229:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789635404.938277:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789635404.938540:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789635404.938582:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635404.938644:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635404.938696:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c4f35900 going to sleep for 11 seconds 00000100:00100000:3.0:1789635404.941303:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043136 00000100:00100000:3.0:1789635404.941373:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043136 00000100:00100000:3.0:1789635404.941446:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789635404.941457:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422043136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635404.941757:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422043136:12345-0@lo:502:mount.lustre.0 Request processed in 301us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635404.941765:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789635404.942042:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635404.942287:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789635404.942303:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789635404.953671:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789635404.953686:0:15180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789635404.953697:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635404.953700:0:15180:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789635404.953705:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789635404.953723:0:15180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e79c6198000) 00000020:00000080:0.0:1789635404.953745:0:15180:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789635404.953750:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789635404.953842:0:15180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79c8381000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789635404.953849:0:15180:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789635404.953855:0:15180:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x77332204cfbb3e60 00010000:00010000:0.0:1789635404.961067:0:15180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1789635404.964619:0:15180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789635404.975856:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789635404.981902:0:15180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789635404.981916:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635404.981923:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635404.981925:0:15180:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789635404.981928:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789635404.981931:0:15180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789635404.981933:0:15180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789635404.981934:0:15180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789635404.981936:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789635404.981938:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635404.981940:0:15180:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789635404.981942:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635404.981945:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635404.981946:0:15180:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789635404.981949:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789635404.981951:0:15180:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789635404.981953:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635404.981954:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635404.981956:0:15180:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789635404.981958:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635404.981959:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635404.981961:0:15180:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789635404.981963:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789635404.982027:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635404.982031:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635404.982032:0:15180:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789635404.982035:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789635404.982564:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789635404.982595:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789635404.982617:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79fe821a00/0x77332204cfbb3e4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e52 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.982629:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79fe821a00/0x77332204cfbb3e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e52 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635404.982639:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79c8381000 from 1 10000000:01000000:3.0:1789635404.982642:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635404.982682:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.982690:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.982712:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635404.982737:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7effb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635404.982808:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635404.982860:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c12edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635404.982940:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043264 00000100:00100000:2.0:1789635404.982948:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043264 00000100:00100000:2.0:1789635404.982997:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789635404.983007:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+14:15166:x1876568422043264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635404.983021:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635404.983034:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3e67 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.983059:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 15 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.983071:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 15 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635404.983081:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820a00, rc 0) 00000100:00100000:2.0:1789635404.983242:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043264:12345-0@lo:101:mount.lustre.0 Request processed in 234us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635404.983249:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789635404.984506:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7effb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635404.984530:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635404.984541:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635404.985047:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789635404.990932:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635404.991260:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789635404.991305:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789635404.992608:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789635404.992626:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789635404.992734:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7effb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635404.992801:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635404.993014:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c12edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789635405.013572:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043392 00000100:00100000:1.0:1789635405.013589:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043392 00000100:00100000:1.0:1789635405.013645:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789635405.013656:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635405.013965:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043392:12345-0@lo:501:mount.lustre.0 Request processed in 310us (21162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.013979:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789635405.014111:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7effb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635405.014189:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635405.014229:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.014266:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635405.014336:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043520 00000100:00100000:2.0:1789635405.014341:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043520 00000100:00100000:2.0:1789635405.014367:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789635405.014375:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635405.014523:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043520:12345-0@lo:503:mount.lustre.0 Request processed in 149us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.014538:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789635405.014683:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043520:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789635405.015440:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635405.015530:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635405.015577:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.015600:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789635405.015711:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043648 00000100:00100000:2.0:1789635405.015717:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043648 00000100:00100000:2.0:1789635405.015755:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789635405.015763:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635405.015917:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043648:12345-0@lo:502:mount.lustre.0 Request processed in 154us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.015924:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789635405.018358:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635405.018665:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789635405.018725:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789635405.018801:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789635405.018838:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789635405.018876:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789635405.018939:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789635405.018981:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789635405.019013:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789635405.019054:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635405.023538:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.023623:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635405.023769:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043776 00000100:00100000:1.0:1789635405.023780:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043776 00000100:00100000:1.0:1789635405.023852:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635405.023862:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635405.024141:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043776:12345-0@lo:502:mount.lustre.0 Request processed in 280us (5020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.024149:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789635405.024225:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635405.024416:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789635405.024432:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789635405.027851:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635405.027864:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635405.027867:0:15184:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789635405.027873:0:15184:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79c8381000 00000020:00000080:0.0:1789635405.027876:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635405.027882:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635405.027885:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635405.027895:0:15184:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789635405.027899:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635405.027901:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635405.027903:0:15184:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789635405.027906:0:15184:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79c8381000 00000020:00000080:0.0:1789635405.027909:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635405.027971:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635405.027975:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635405.027977:0:15184:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789635405.027979:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789635405.027982:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635405.027983:0:15184:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789635405.027987:0:15184:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e79c8381000 00000020:00000080:0.0:1789635405.027989:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789635405.028022:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789635405.028025:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789635405.028026:0:15184:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789635405.028029:0:15184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789635405.046013:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789635405.046055:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789635405.046084:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.046097:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635405.046156:0:15166:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789635405.046159:0:15166:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e79c8381000 10000000:01000000:1.0:1789635405.046162:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e79c8381000 10000000:01000000:1.0:1789635405.046166:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635405.046173:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79c8381000 from 1 10000000:01000000:1.0:1789635405.046175:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789635405.046226:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb3e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.046246:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb3e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.046259:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb3e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635405.046283:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635405.048245:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.048291:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422043904 00000100:00100000:1.0:1789635405.048300:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d118a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789635405.048301:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422043904 00000100:00100000:0.0:1789635405.048671:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789635405.048682:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422043904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635405.048702:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635405.048723:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c0030200/0x77332204cfbb3e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3e75 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.048750:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030200/0x77332204cfbb3e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3e75 expref: 16 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.048761:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c0030200/0x77332204cfbb3e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e75 expref: 16 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.048782:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c0030200, rc 0) 00000100:00100000:0.0:1789635405.048883:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422043904:12345-0@lo:101:mount.lustre.0 Request processed in 203us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635405.048890:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789635405.049528:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422043904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635405.049550:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb3e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e7c expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.049561:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb3e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3e7c expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789635405.051703:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789635405.052084:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789635405.056651:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789635405.056710:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789635405.056740:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789635405.056782:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789635405.056815:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789635405.056857:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789635405.056889:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789635405.056921:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789635405.056968:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789635405.057017:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789635405.057048:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789635405.057112:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789635405.061799:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789635405.061841:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789635405.061911:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789635405.061944:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789635405.061976:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789635405.062021:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789635405.062057:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789635405.062091:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789635405.063385:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789635405.063458:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789635405.063491:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789635405.063535:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789635405.063569:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789635405.063626:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789635405.063671:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789635405.063702:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789635405.063792:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789635405.063800:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789635405.063921:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635405.063990:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635405.077116:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c70e83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635405.079751:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044032 00000100:00100000:1.0:1789635405.079769:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044032 00000100:00100000:2.0:1789635405.079910:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789635405.079923:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044032:12345-0@lo:501:mount.lustre.0 00000100:00080000:0.0:1789635405.080268:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635405.080274:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789635405.080277:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789635405.080279:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789635405.080362:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422044160:0@lo:400:kworker.0 00000100:00100000:0.0:1789635405.080427:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635405.080803:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044160 00000100:00100000:3.0:1789635405.080809:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044160 00000100:00100000:3.0:1789635405.080844:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635405.080852:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422044160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635405.080910:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422044160:12345-0@lo:400:kworker.0 Request processed in 59us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635405.080928:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789635405.080982:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e79dba5e680 x1876568422044160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635405.080996:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422044160:0@lo:400:kworker.0 00000100:00100000:2.0:1789635405.081578:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044032:12345-0@lo:501:mount.lustre.0 Request processed in 1657us (17586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.081586:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789635405.099666:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635405.106687:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789635405.106778:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.106820:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635405.111067:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044288 00000100:00100000:3.0:1789635405.111083:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044288 00000100:00100000:3.0:1789635405.111142:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789635405.111153:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044288:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635405.111525:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044288:12345-0@lo:503:mount.lustre.0 Request processed in 372us (4745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635405.111535:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789635405.114869:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789635405.116091:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635405.119361:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635405.119467:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.119511:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635405.120795:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044416 00000100:00100000:2.0:1789635405.120810:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044416 00000100:00100000:2.0:1789635405.120865:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789635405.120888:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635405.121258:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044416:12345-0@lo:502:mount.lustre.0 Request processed in 374us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635405.121266:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789635405.123722:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635405.124035:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789635405.124092:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789635405.124144:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789635405.124234:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789635405.124282:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789635405.124508:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789635405.124550:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789635405.124580:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789635405.124631:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789635405.124664:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789635405.124697:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789635405.124743:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789635405.124778:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789635405.124815:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789635405.124864:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789635405.124902:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789635405.124936:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789635405.124983:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789635405.125018:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789635405.125068:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789635405.125130:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789635405.125168:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789635405.128831:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789635405.128962:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789635405.129003:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789635405.129039:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789635405.129089:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789635405.129138:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789635405.129174:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789635405.132020:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789635405.132093:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789635405.132140:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789635405.132175:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789635405.132254:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789635405.132292:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789635405.134025:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789635405.134086:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789635405.134196:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789635405.134267:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789635405.134300:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789635405.136419:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635405.136523:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.136567:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789635405.136744:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044544 00000100:00100000:1.0:1789635405.136753:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044544 00000100:00100000:1.0:1789635405.136805:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789635405.136815:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635405.137068:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044544:12345-0@lo:502:mount.lustre.0 Request processed in 254us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.137075:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789635405.137664:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635405.137797:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789635405.137814:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789635405.157951:0:15189:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789635405.157970:0:15189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e79fe9199c0) 00000020:00000080:1.0:1789635405.158007:0:15189:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789635405.158083:0:15189:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79c8381000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789635405.158088:0:15189:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79c8381000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789635405.158091:0:15189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79c8381000 3 00010000:00080000:1.0:1789635405.158135:0:15189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79c93f0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789635405.161083:0:15189:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789635405.165110:0:15189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789635405.165462:0:15189:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789635405.165477:0:15189:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x77332204cfbb3e8a 00000100:00080000:1.0:1789635405.165491:0:15189:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635405.165505:0:15189:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e79c93f0800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789635405.165549:0:15189:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fe905180 x1876568422044672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789635405.165609:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876568422044672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789635405.165682:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635405.165778:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044672 00000100:00100000:1.0:1789635405.165787:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044672 00000100:00100000:1.0:1789635405.165820:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635405.165827:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876568422044672:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789635405.165851:0:14486:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 380 last 0 00000020:00000080:1.0:1789635405.165880:0:14486:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x77332204cfbb3e91 00000004:00100000:1.0:1789635405.165894:0:14486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789635405.165936:0:14486:0:(import.c:65:import_set_state_nolock()) ffff9e79f30f0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635405.171358:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876568422044672:12345-0@lo:38:llog_process_th.0 Request processed in 5520us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.171376:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789635405.171517:0:15189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789635405.171539:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635405.171544:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789635405.171547:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635405.171550:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789635405.175828:0:15189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1789635405.177416:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e79fe905180 x1876568422044672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635405.177433:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635405.177443:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789635405.177452:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789635405.177459:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789635405.177463:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79c93f0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789635405.177470:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876568422044672:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789635405.177518:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789635405.177553:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789635405.177566:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb3e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e7c expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.177577:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84200/0x77332204cfbb3e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3e7c expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789635405.177644:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789635405.177646:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789635405.177648:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635405.177650:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635405.177651:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635405.177652:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635405.177654:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635405.177656:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635405.177658:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635405.177662:0:15166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789635405.177664:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635405.177666:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789635405.177667:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635405.177669:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635405.177670:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635405.177671:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635405.177672:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635405.177674:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635405.177675:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635405.177697:0:15166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789635405.177715:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789635405.177776:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.178021:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789635405.184372:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044800 00000100:00100000:3.0:1789635405.184389:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044800 00000100:00100000:3.0:1789635405.184447:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789635405.184459:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15166:x1876568422044800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789635405.184495:0:14478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789635405.184509:0:14478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789635405.237284:0:14478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789635405.237297:0:14478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789635405.237503:0:14500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789635405.237509:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789635405.237533:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.237552:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 16 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.237562:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.237619:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 16 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635405.237633:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 16 pid: 14479 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635405.237647:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876568422044928:0@lo:104: 00000100:00100000:0.0:1789635405.237710:0:14500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635405.237762:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635405.239657:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422044928 00000100:00100000:3.0:1789635405.239671:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422044928 00000100:00100000:3.0:1789635405.239720:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635405.239730:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14500:x1876568422044928:12345-0@lo:104: 00010000:00010000:3.0:1789635405.239747:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635405.239928:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635405.239936:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14500:x1876568422044928:12345-0@lo:104: Request processed in 207us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635405.239952:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789635405.240753:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635405.240764:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.240782:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:1.0:1789635405.240786:0:14473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.240795:0:14473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789635405.240802:0:14473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635405.240807:0:14473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789635405.240853:0:14473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.240860:0:14473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789635405.240880:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.240887:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79fe820800/0x77332204cfbb3dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e05 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.240902:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635405.240903:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635405.240905:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635405.240924:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422045056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789635405.240971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635405.241036:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045056 00000100:00100000:1.0:1789635405.241042:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045056 00010000:00010000:1.0:1789635405.241061:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 17 pid: 14479 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635405.241091:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635405.241097:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:3306:x1876568422045056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789635405.241107:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635405.241113:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 17 pid: 14479 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241123:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 17 pid: 14479 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241142:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241150:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789635405.241166:0:14469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010607789s 00010000:00010000:1.0:1789635405.241170:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241190:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241197:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241204:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241210:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635405.241222:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241230:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241238:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635405.241248:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635405.241280:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:3306:x1876568422045056:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.241287:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635405.241361:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422045056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789635405.249035:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821600/0x77332204cfbb3e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb3dfe expref: 16 pid: 14479 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635405.249058:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876568422044928:0@lo:104: 00010000:00010000:2.0:1789635405.249086:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.249098:0:14500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.249105:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635405.249112:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79c0030e00/0x77332204cfbb3e98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635405.249957:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:15166:x1876568422044800:12345-0@lo:253:mount.lustre.0 Request processed in 65495us (72175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635405.249971:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789635405.250119:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15166:1876568422044800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789635405.250135:0:15166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789635405.250139:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789635405.250141:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789635405.250142:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635405.250143:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635405.250145:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635405.250146:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635405.250148:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635405.250150:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635405.250152:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789635405.250164:0:15166:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789635405.261785:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789635405.261947:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789635405.263307:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635405.263591:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789635405.263865:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635405.264087:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789635405.266560:0:15166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789635405.353801:0:15166:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789635405.353811:0:15166:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789635405.353843:0:15166:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789635405.353899:0:15166:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789635405.353912:0:15166:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789635405.353945:0:15166:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789635405.843562:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635406.867749:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789635407.124028:0:14481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789635407.124044:0:14481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79e734d800 from 7 10000000:01000000:1.0:1789635407.124049:0:14481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789635407.124096:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.124108:0:14481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635407.124119:0:14481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635407.124155:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422045184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789635407.124222:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635407.124273:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c3f26300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635407.124830:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045184 00000100:00100000:2.0:1789635407.124841:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045184 00000100:00100000:2.0:1789635407.125685:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789635407.125697:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+15:14481:x1876568422045184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635407.125712:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635407.125740:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3e9f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.125777:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 16 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.125787:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 16 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635407.125796:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820000, rc 0) 00000100:00100000:2.0:1789635407.125856:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:14481:x1876568422045184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635407.125863:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789635407.125930:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422045184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635407.125945:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.125963:0:14481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635407.126015:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422045312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789635407.126046:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635407.127665:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d00efa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635407.130530:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045312 00000100:00100000:0.0:1789635407.130544:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045312 00000100:00100000:0.0:1789635407.130594:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635407.130603:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:14481:x1876568422045312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789635407.130628:0:14479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789635407.130643:0:14479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789635407.130649:0:14479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789635407.135185:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:14481:x1876568422045312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 4569us (9124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635407.135200:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789635407.135282:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422045312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789635407.135552:0:14481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789635407.135561:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635407.135571:0:14481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635407.892828:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635408.918084:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635409.940899:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789635410.195568:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635410.195575:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789635410.195578:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635410.195580:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789635410.195628:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422045568:0@lo:400:kworker.0 00000100:00100000:1.0:1789635410.195697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635410.195762:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635410.195769:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422045696:0@lo:400:kworker.0 00000100:00100000:1.0:1789635410.195795:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635410.195840:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045568 00000100:00100000:1.0:1789635410.195848:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045568 00000100:00100000:1.0:1789635410.195887:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045696 00000100:00100000:1.0:1789635410.195910:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045696 00000100:00100000:1.0:1789635410.195941:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635410.195959:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422045568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635410.196026:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422045568:12345-0@lo:400:kworker.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.196042:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635410.196060:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635410.196067:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422045696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635410.196105:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422045696:12345-0@lo:400:kworker.0 Request processed in 39us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.196111:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789635410.196389:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79fe906300 x1876568422045696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635410.196405:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422045696:0@lo:400:kworker.0 00010000:00080000:1.0:1789635410.196416:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79fe906a00 x1876568422045568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635410.196424:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422045568:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.196555:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635410.196566:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422045440:0@lo:400:kworker.0 00000100:00100000:3.0:1789635410.196604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789635410.196657:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635410.196705:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045440 00000100:00100000:1.0:1789635410.196709:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045440 00000100:00100000:1.0:1789635410.196743:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635410.196751:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:3306:x1876568422045440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635410.196790:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:3306:x1876568422045440:12345-0@lo:400:kworker.0 Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635410.196796:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789635410.196829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422045440:0@lo:400:kworker.0 00010000:00010000:3.0:1789635410.964388:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789635411.863624:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789635411.991473:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635412.957591:0:15533:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789635413.011836:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635414.048673:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635414.421834:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635399/real 1789635399] req@ffff9e78c1382a00 x1876568422041472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635414 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635414.421869:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e78c1382a00 x1876568422041472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635414 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635414.421880:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789635399/real 1789635399] req@ffff9e78c1380380 x1876568422041600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635414 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635414.421892:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e78c1380380 x1876568422041600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789635414 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635414.421911:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79e73b0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635414.421925:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635414.421929:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422041472:0@lo:8:kworker.0 00000100:00080000:0.0:1789635414.421934:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635414.421947:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789635414.421950:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422041600:0@lo:8:kworker.0 00000100:00080000:3.0:1789635414.422431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635414.422437:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789635414.422440:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79e73b0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635414.422446:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 375 00000100:00080000:3.0:1789635414.422451:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789635414.422462:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e79e73b0800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635414.422483:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79e7efc000 x1876568422045952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789635414.422505:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635414.422509:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789635414.422511:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635414.422514:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 375 00000100:00080000:3.0:1789635414.422518:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789635414.422523:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79dc2fd000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635414.422536:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79e7eff480 x1876568422046080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635414.422585:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422046208:0@lo:400:kworker.0 00000100:00100000:3.0:1789635414.422658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635414.422927:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789635414.422935:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422045824:0@lo:400:kworker.0 00000100:00100000:3.0:1789635414.422968:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635414.423008:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422046336:0@lo:400:kworker.0 00000100:00100000:3.0:1789635414.423046:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635414.423081:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046208 00000100:00100000:3.0:1789635414.423090:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046208 00000100:00100000:3.0:1789635414.423128:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046336 00000100:00100000:3.0:1789635414.423131:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046336 00000100:00100000:3.0:1789635414.423157:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789635414.423176:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422046208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635414.423361:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045824 00000100:00100000:0.0:1789635414.423366:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045824 00000100:00100000:0.0:1789635414.423396:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789635414.423403:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:3307:x1876568422045824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635414.423437:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:3307:x1876568422045824:12345-0@lo:400:kworker.0 Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635414.423444:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789635414.424106:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422046208:12345-0@lo:400:kworker.0 Request processed in 62us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635414.424117:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789635414.424136:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635414.424155:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422046336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635414.424272:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422046336:12345-0@lo:400:kworker.0 Request processed in 118us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635414.424278:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789635414.424304:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789635414.424334:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422045952:0@lo:8:kworker.0 00000100:00100000:3.0:1789635414.424370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635414.424394:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422046080:0@lo:8:kworker.0 00000100:00100000:3.0:1789635414.424416:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635414.424456:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422045824:0@lo:400:kworker.0 00010000:00080000:3.0:1789635414.424469:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79e7efd180 x1876568422046208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789635414.424479:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422046208:0@lo:400:kworker.0 00000100:00100000:3.0:1789635414.425439:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422045952 00000100:00100000:3.0:1789635414.425449:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422045952 00000100:00100000:3.0:1789635414.425472:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046080 00000100:00100000:3.0:1789635414.425474:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046080 00000100:00100000:3.0:1789635414.425486:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635414.425492:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876568422045952:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789635414.425518:0:15169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:3.0:1789635414.425545:0:15169:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb3ead 00002000:00100000:3.0:1789635414.425558:0:15169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e79c7341800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789635414.425568:0:15169:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789635414.425571:0:15169:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789635414.427251:0:15169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789635414.427289:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9e79c7344000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635414.427395:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876568422045952:12345-0@lo:8:kworker.0 Request processed in 1901us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635414.427405:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635414.427433:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635414.427439:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876568422046080:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789635414.427452:0:15169:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789635414.427908:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79e7efc000 x1876568422045952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635414.427920:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789635414.427931:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789635414.427940:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789635414.427946:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789635414.427948:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79e73b0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789635414.427983:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789635414.427990:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422045952:0@lo:8:kworker.0 00000004:00080000:0.0:1789635414.428578:0:14506:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789635414.429006:0:14506:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390248693236ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789635414.431578:0:14507:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789635414.431610:0:14507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876568422046592:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789635414.431684:0:14507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635414.431877:0:14507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e78c21f4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789635414.431906:0:15170:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789635414.431913:0:15170:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789635414.432858:0:15167:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789635414.432875:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046592 00000100:00100000:0.0:1789635414.432885:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046592 00010000:00080000:2.0:1789635414.433140:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79e7efe680 x1876568422046336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635414.433156:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422046336:0@lo:400:kworker.0 00000100:00100000:2.0:1789635414.433186:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635414.441436:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422046464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789635414.441513:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789635414.442467:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635414.442951:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046464 00000100:00100000:0.0:1789635414.442961:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046464 00000100:00100000:0.0:1789635414.443008:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635414.443032:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422046464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635414.443069:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635414.443136:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422046464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635414.443143:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789635414.453487:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e79dba5c380 x1876568422046464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635414.453516:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422046464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789635414.480841:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789635414.480849:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789635414.480854:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422046080:0@lo:8:kworker.0 00000100:00100000:3.0:1789635414.480941:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876568422046080:12345-0@lo:8:kworker.0 Request processed in 53194us (56217us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789635414.480953:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789635414.480981:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635414.480994:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14507:x1876568422046592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789635414.491762:0:15169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789635414.491773:0:15169:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789635414.491779:0:15169:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1789635414.508823:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.508835:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508851:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.508856:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.508862:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508881:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508904:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508912:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508933:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.508946:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.508952:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508960:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.508964:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508974:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508990:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.508997:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b31ae61/0x77332204cfbb3eb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.509801:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.509811:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.509819:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.510363:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.510611:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510624:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.510629:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.510635:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510656:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510666:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510674:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510694:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.510704:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.510709:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510716:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.510720:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510740:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510754:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510761:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff3b3449/0x77332204cfbb3ebb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.510776:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.510777:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.510779:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.511360:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.511444:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511455:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.511459:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.511463:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511472:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511481:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511495:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511510:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.511519:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.511523:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511529:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.511533:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511540:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511552:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511559:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733664da/0x77332204cfbb3ec2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.511574:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.511575:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.511577:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.513192:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.513210:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.513222:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.513991:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.514001:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514029:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514038:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514046:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514072:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635414.514848:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.514856:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514868:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.514872:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.514877:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514887:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514902:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514910:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514926:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789635414.514938:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635414.514943:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514951:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.514956:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514965:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514982:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.514990:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a3218cc/0x77332204cfbb3ec9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.515008:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.515031:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.515037:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.515041:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.515048:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.515059:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.515066:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001062b57c/0x77332204cfbb3ed0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.515078:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.515080:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.515082:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.515877:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.521141:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.521157:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.521177:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.521182:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.521188:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.521218:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.521239:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.521247:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.521279:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635414.521463:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635414.521470:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.521478:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.521483:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.521491:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.521512:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.521519:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038fa0aa4/0x77332204cfbb3ed7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.521540:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.521542:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.521543:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.522151:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.522159:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.522169:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.522173:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.522177:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.522188:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.522196:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.522215:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.522522:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635414.522967:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.522973:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.522983:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.522986:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.522990:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.522998:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.523007:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.523026:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.523548:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635414.523556:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.523565:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.523578:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.523587:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.523603:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.523609:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae6d8b01/0x77332204cfbb3ede lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.530500:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.530524:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.530532:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.530557:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c72800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.530561:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.530573:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.530593:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.530601:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000354961c2/0x77332204cfbb3ee5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.530625:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.530626:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.530628:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.531397:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.531406:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531419:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.531424:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.531430:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531442:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531469:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531476:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531493:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.531502:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.531506:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531512:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73c00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.531516:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531524:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531535:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531543:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066dbd8ec/0x77332204cfbb3eec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.531556:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.531563:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.531564:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.531829:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.531833:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.531835:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.537607:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.537622:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.537639:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.537644:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.540025:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.540049:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.540062:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.540069:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.540092:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635414.540566:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635414.540574:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.540584:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635414.540588:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.540607:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.540627:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.540636:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2d81b58/0x77332204cfbb3ef3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.540672:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635414.540673:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635414.540675:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.553001:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.553027:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.553045:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.553050:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.553055:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.553077:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.553087:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.553095:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.553120:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635414.553394:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635414.553403:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.553412:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.553416:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.553426:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.553445:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.553460:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068741ba2/0x77332204cfbb3efa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.553481:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.553483:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.553484:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635414.556064:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635414.556076:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556092:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1789635414.556096:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635414.556102:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556115:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556124:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556142:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556170:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.556188:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.556193:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556201:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.556205:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556214:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556229:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556236:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be53316/0x77332204cfbb3f01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.556255:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.556257:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.556258:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789635414.562083:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789635414.562094:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.562111:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1789635414.562116:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635414.562122:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.562136:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.562147:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.562162:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.562184:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789635414.564248:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789635414.564259:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.564276:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1789635414.564280:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635414.564287:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.564300:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.564326:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.564335:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.564354:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789635414.564634:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635414.564642:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565140:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.565146:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565156:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565175:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565183:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb3f08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565203:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635414.565206:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565222:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.565226:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565234:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565245:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565252:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb3f0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.565266:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.565268:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.565270:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.566581:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789635414.569306:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789635414.569337:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.569360:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1789635414.573073:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635414.573096:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.573118:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.573132:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.573141:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635414.573186:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789635414.576125:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635414.576140:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.576155:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.576161:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.576172:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.576202:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.576210:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f161780/0x77332204cfbb3f16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.576235:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.576236:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.576238:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789635414.585961:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1789635414.586222:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.586232:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586250:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.586255:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.586261:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586291:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586304:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586339:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586430:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789635414.586894:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.586900:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586909:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.586912:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.586916:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586925:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586933:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586950:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.586971:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789635414.587389:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.587395:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587404:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.587407:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.587412:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587421:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587429:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587436:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587445:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789635414.587800:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.587806:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587819:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.587822:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.587826:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587835:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587843:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587850:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.587857:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789635414.588224:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.588230:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588239:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.588242:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.588246:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588255:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588274:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588282:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588290:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1789635414.588697:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.588703:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588711:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.588713:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.588717:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588726:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588734:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588741:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.588760:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1789635414.589873:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789635414.589883:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589893:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.589898:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589908:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589926:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589933:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc5ec6b4/0x77332204cfbb3f1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589961:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789635414.589965:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589971:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.589974:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589982:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589991:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.589998:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b8ddb8/0x77332204cfbb3f24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590040:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789635414.590044:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590050:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.590054:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590072:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590082:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590089:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9def32b/0x77332204cfbb3f2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590100:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789635414.590104:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590110:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.590113:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590121:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590129:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590136:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b082da/0x77332204cfbb3f32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590157:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635414.590160:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590166:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030c00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.590169:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590178:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590187:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590194:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e66286a/0x77332204cfbb3f39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590204:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635414.590208:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590214:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.590218:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590234:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590244:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590250:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d80f3f11/0x77332204cfbb3f40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.590262:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.590263:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.590265:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.593799:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635414.607973:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.607987:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.608005:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.608021:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.608027:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.608041:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.608052:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.608060:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.608085:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789635414.609206:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.609214:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.609225:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.609235:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.609241:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.609253:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.609262:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.609268:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.609289:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789635414.609749:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635414.609757:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609765:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031c00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.609770:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609779:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609797:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609804:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b39abd70/0x77332204cfbb3f47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609824:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.609828:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609834:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.609837:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609844:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609861:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609868:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078138e61/0x77332204cfbb3f4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.609879:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.609881:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.609882:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635414.611781:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.611795:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.611810:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.611886:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.611893:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.611907:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.611917:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.611936:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.612021:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.612938:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.612947:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.612957:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0030e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.612962:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.612972:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.612989:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.612996:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000635f3801/0x77332204cfbb3f55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.613044:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.613046:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.613048:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.617721:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635414.619292:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.619306:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.619347:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.619353:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.619360:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.619375:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.619389:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.619397:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.619421:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.621089:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.621099:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.621111:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c0031000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.621116:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.623767:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.623789:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.623797:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076de1761/0x77332204cfbb3f5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635414.624357:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.624363:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.624382:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.624386:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.624394:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.624408:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.624417:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.624425:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.624445:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635414.624737:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635414.624743:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.624749:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02050600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635414.624757:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.624763:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.624771:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.624775:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ca76e03/0x77332204cfbb3f63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635414.624785:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.624786:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.624787:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.625174:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789635414.630094:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789635414.630107:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.630120:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1789635414.630123:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635414.630128:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.630139:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.630170:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.630178:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635414.630201:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789635414.634115:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789635414.634128:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634141:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1789635414.634145:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635414.634152:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634167:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634195:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634203:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634221:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789635414.634234:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789635414.634240:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634248:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02050e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.634252:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634261:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634280:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634287:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba9d7edb/0x77332204cfbb3f6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634306:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789635414.634335:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634341:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635414.634343:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634348:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634355:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634359:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050260807/0x77332204cfbb3f71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635414.634372:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.634373:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635414.634375:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635414.636132:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789635414.636779:0:15169:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1789635414.639787:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14507:x1876568422046592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 158793us (208098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635414.639804:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635414.640803:0:14507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876568422046592:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789635414.641946:0:14507:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789635414.641999:0:14507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876568422046720:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789635414.642078:0:14507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635414.642117:0:14507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789635414.642263:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046720 00000100:00100000:1.0:1789635414.642271:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046720 00000100:00100000:1.0:1789635414.643566:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635414.643578:0:15167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14507:x1876568422046720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789635414.643630:0:15167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1789635414.660248:0:15167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14507:x1876568422046720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16660us (18156us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789635414.660263:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635414.668227:0:14507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe904380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876568422046720:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789635414.668252:0:14507:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789635415.062202:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789635416.027585:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789635416.027639:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789635416.084900:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635417.111990:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635418.133282:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635419.155881:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635419.924690:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635419.924985:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422047104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635419.925058:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635419.925125:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422047104 00000100:00100000:0.0:1789635419.928186:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422047104 00000100:00100000:0.0:1789635419.928283:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789635419.928297:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422047104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789635419.928364:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635419.928452:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422047104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635419.928458:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789635419.929608:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635419.930124:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789635419.930909:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422047104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635419.931022:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422046976:0@lo:400:kworker.0 00000100:00100000:3.0:1789635419.931093:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635419.931144:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422046848:0@lo:400:kworker.0 00000100:00100000:3.0:1789635419.931171:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635419.931217:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046848 00000100:00100000:3.0:1789635419.931224:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046848 00000100:00100000:3.0:1789635419.931266:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789635419.931276:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:3307:x1876568422046848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635419.931362:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:3307:x1876568422046848:12345-0@lo:400:kworker.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635419.931369:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789635419.931412:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422046848:0@lo:400:kworker.0 00000100:00100000:0.0:1789635419.931700:0:15593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422046976 00000100:00100000:0.0:1789635419.931705:0:15593:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422046976 00000100:00100000:0.0:1789635419.932433:0:15593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789635419.932457:0:15593:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422046976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635419.933240:0:15593:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422046976:12345-0@lo:400:kworker.0 Request processed in 784us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635419.933250:0:15593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789635419.934217:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422046976:0@lo:400:kworker.0 00000100:00080000:2.0:1789635419.939139:0:1466:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789635419.939150:0:1466:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789635419.939154:0:1466:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789635419.939162:0:1466:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 390 00000100:00080000:2.0:1789635419.939169:0:1466:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789635419.939182:0:1466:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79dc2fd000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789635419.939342:0:1466:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e78c1381880 x1876568422047232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789635419.939422:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422047488:0@lo:400:kworker.0 00000100:00100000:2.0:1789635419.939636:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635419.939690:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422047488 00000100:00100000:2.0:1789635419.939699:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422047488 00000100:00100000:2.0:1789635419.939816:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789635419.939825:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422047488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635419.939878:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422047488:12345-0@lo:400:kworker.0 Request processed in 53us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635419.939886:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789635419.939941:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e78c1381180 x1876568422047488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635419.939956:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422047488:0@lo:400:kworker.0 00000100:00080000:2.0:1789635419.939978:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635419.942433:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422047232:0@lo:8:kworker.0 00000100:00100000:0.0:1789635419.942512:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635419.942562:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422047232 00000100:00100000:0.0:1789635419.942570:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422047232 00000100:00100000:0.0:1789635419.942604:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789635419.942611:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876568422047232:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789635419.942632:0:15169:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789635419.949098:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422047360:0@lo:400:kworker.0 00000100:00100000:1.0:1789635419.949190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635419.949402:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422047360 00000100:00100000:3.0:1789635419.949412:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422047360 00000100:00100000:3.0:1789635419.949464:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789635419.949474:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422047360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635419.949538:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422047360:12345-0@lo:400:kworker.0 Request processed in 65us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635419.949545:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789635419.949822:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e78c1382300 x1876568422047360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635419.949838:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422047360:0@lo:400:kworker.0 00000100:00100000:0.0:1789635419.982271:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876568422047232:12345-0@lo:8:kworker.0 Request processed in 39649us (39749us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789635419.982286:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789635419.982443:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635419.982450:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789635419.982454:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422047232:0@lo:8:kworker.0 00010000:00010000:0.0:1789635420.193853:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789635421.079846:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789635421.203981:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635422.234273:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789635423.078042:0:15887:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789635423.078046:0:15887:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789635423.078265:0:15887:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e79fe701000 00000020:01000004:2.0:1789635423.078283:0:15887:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789635423.078297:0:15887:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789635423.079202:0:15887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e79e7b299c0) 00000020:00000080:2.0:1789635423.079235:0:15887:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789635423.118566:0:15887:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789635423.118844:0:15887:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789635423.120751:0:15887:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789635423.121031:0:15887:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789635423.121419:0:15887:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789635423.121764:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1789635423.121871:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1789635423.121969:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1789635423.122945:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 589: rc = 0 00100000:10000000:0.0:1789635423.123678:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 589: rc = 0 00100000:10000000:0.0:1789635423.124556:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 589: rc = 0 00100000:10000000:0.0:1789635423.125076:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 589: rc = 0 00100000:10000000:0.0:1789635423.125420:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 589: rc = 0 00100000:10000000:0.0:1789635423.125676:0:15887:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 589: rc = 0 00000020:00000080:0.0:1789635423.126523:0:15887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789635423.126536:0:15887:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789635423.126548:0:15887:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x77332204cfbb3f7f 00000020:01000004:0.0:1789635423.126557:0:15887:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789635423.126580:0:15887:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789635423.126584:0:15887:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789635423.126591:0:15887:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789635423.126614:0:15887:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789635423.126619:0:15887:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789635423.137556:0:15887:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789635423.137599:0:15887:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789635423.137605:0:15887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789635423.137607:0:15887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635423.137608:0:15887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635423.137610:0:15887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635423.137611:0:15887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635423.137612:0:15887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635423.137614:0:15887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635423.137615:0:15887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635423.137617:0:15887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789635423.137621:0:15887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789635423.137623:0:15887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635423.137625:0:15887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635423.137626:0:15887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635423.137628:0:15887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635423.137629:0:15887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635423.137630:0:15887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635423.137631:0:15887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635423.137632:0:15887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635423.137633:0:15887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789635423.137682:0:15887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789635423.137709:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422047616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789635423.137779:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.137908:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d114aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635423.138588:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422047616 00000100:00100000:1.0:1789635423.138598:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422047616 00000100:00100000:1.0:1789635423.138715:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789635423.138727:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15887:x1876568422047616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789635423.138758:0:14479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789635423.138762:0:14479:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789635423.138766:0:14479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789635423.161460:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15887:x1876568422047616:12345-0@lo:253:mount.lustre.0 Request processed in 22726us (23671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.161477:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789635423.161922:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422047616:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789635423.162043:0:15887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789635423.162047:0:15887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789635423.162049:0:15887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635423.162050:0:15887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635423.162051:0:15887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635423.162053:0:15887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635423.162055:0:15887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635423.162056:0:15887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635423.162059:0:15887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635423.162060:0:15887:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789635423.162448:0:15887:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e79fe701000 from lustre-OST0001 10000000:01000000:3.0:1789635423.162475:0:15887:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789635423.162478:0:15887:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789635423.162485:0:15887:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e79fe918000 local copy 00010000:00010000:3.0:1789635423.162496:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635423.162950:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422047744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635423.163076:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635423.163181:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d108bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789635423.163236:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422047744 00000100:00100000:0.0:1789635423.163243:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422047744 00000100:00100000:0.0:1789635423.163366:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789635423.163376:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15887:x1876568422047744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635423.163542:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15887:x1876568422047744:12345-0@lo:501:mount.lustre.0 Request processed in 168us (467us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635423.163550:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789635423.163906:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422047744:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789635423.163924:0:15887:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789635423.164104:0:15887:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789635423.164114:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635423.164125:0:15887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84e00/0x77332204cfbb3d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3d2c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789635423.164150:0:15887:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e79fe701000 10000000:01000000:1.0:1789635423.164156:0:15887:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789635423.164161:0:15887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789635423.164163:0:15887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789635423.164168:0:15887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789635423.164171:0:15887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789635423.164199:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb3f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635423.164207:0:15887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb3f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635423.164217:0:15887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb3f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635423.164244:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422047872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789635423.164279:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.164345:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c3f260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635423.164523:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422047872 00000100:00100000:2.0:1789635423.164529:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422047872 00000100:00100000:2.0:1789635423.164568:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789635423.164576:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:15887:x1876568422047872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789635423.164587:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635423.164601:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821400/0x77332204cfbb3f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3f86 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635423.164630:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821400/0x77332204cfbb3f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3f86 expref: 17 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635423.164640:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821400/0x77332204cfbb3f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3f86 expref: 17 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635423.164650:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821400, rc 0) 00000100:00100000:2.0:1789635423.164902:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422047872:12345-0@lo:101:mount.lustre.0 Request processed in 326us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.164909:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789635423.165202:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422047872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635423.165216:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb3f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3f8d expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635423.165227:0:15887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb3f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3f8d expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789635423.166608:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789635423.169169:0:15887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789635423.169453:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789635423.169495:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789635423.169524:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789635423.169575:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789635423.169607:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789635423.169645:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789635423.169699:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789635423.169706:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789635423.169791:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635423.169850:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.169909:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d86b9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635423.170342:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048000 00000100:00100000:3.0:1789635423.170361:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048000 00000100:00100000:3.0:1789635423.170413:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789635423.170423:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635423.170786:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048000:12345-0@lo:501:mount.lustre.0 Request processed in 364us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.170795:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789635423.175049:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635423.175115:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635423.175197:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.175245:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d86b9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635423.175879:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048128 00000100:00100000:3.0:1789635423.175888:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048128 00000100:00100000:3.0:1789635423.175944:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789635423.175954:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635423.176387:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048128:12345-0@lo:503:mount.lustre.0 Request processed in 433us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.176396:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789635423.176610:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048128:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789635423.177599:0:15887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789635423.177881:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635423.177942:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.177990:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d86b9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789635423.178183:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048256 00000100:00100000:3.0:1789635423.178190:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048256 00000100:00100000:3.0:1789635423.178236:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789635423.178245:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635423.179019:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048256:12345-0@lo:502:mount.lustre.0 Request processed in 772us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.179028:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789635423.179150:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635423.179539:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789635423.179586:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789635423.179613:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789635423.179650:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789635423.179809:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789635423.179845:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789635423.179910:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789635423.179945:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789635423.179993:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789635423.180031:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635423.180085:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.180178:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d86b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1789635423.181125:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048384 00000100:00100000:0.0:1789635423.181136:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048384 00000100:00100000:1.0:1789635423.185093:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789635423.185109:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635423.185455:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048384:12345-0@lo:502:mount.lustre.0 Request processed in 349us (5369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.185463:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789635423.185570:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe906d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789635423.185700:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789635423.185717:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789635423.188920:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789635423.188933:0:15888:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789635423.188939:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635423.188942:0:15888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789635423.188950:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789635423.188966:0:15888:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e79e7b2cd40) 00000020:00000080:2.0:1789635423.188993:0:15888:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789635423.188999:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789635423.189072:0:15888:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79fe701000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789635423.189080:0:15888:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789635423.189088:0:15888:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x77332204cfbb3f9b 00010000:00010000:3.0:1789635423.199182:0:15888:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789635423.200064:0:15888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789635423.209581:0:15888:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789635423.217150:0:15888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789635423.217163:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635423.217170:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635423.217182:0:15888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789635423.217187:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635423.217191:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635423.217193:0:15888:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789635423.217196:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789635423.217199:0:15888:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789635423.217201:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635423.217204:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635423.217205:0:15888:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789635423.217208:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789635423.217210:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635423.217211:0:15888:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789635423.217215:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789635423.217280:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789635423.217284:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789635423.217285:0:15888:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789635423.217289:0:15888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789635423.221561:0:15887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789635423.221604:0:15887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789635423.221622:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb3f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3f8d expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.221634:0:15887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84600/0x77332204cfbb3f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3f8d expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635423.221673:0:15887:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fe701000 from 1 10000000:01000000:3.0:1789635423.221676:0:15887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789635423.221716:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.221725:0:15887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.221737:0:15887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635423.221761:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789635423.221832:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635423.221895:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca5d09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635423.222463:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048512 00000100:00100000:1.0:1789635423.222473:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048512 00000100:00100000:1.0:1789635423.222524:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789635423.222534:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:15887:x1876568422048512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789635423.222548:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635423.222563:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3fa2 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635423.222587:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635423.222598:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635423.222606:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85000, rc 0) 00000100:00100000:1.0:1789635423.222677:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422048512:12345-0@lo:101:mount.lustre.0 Request processed in 144us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.222684:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789635423.223492:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635423.223514:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.223525:0:15887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635423.224075:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789635423.230944:0:15887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789635423.232727:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789635423.232810:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789635423.232907:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789635423.232916:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789635423.233027:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635423.233102:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635423.234597:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca5d09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635423.242979:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048640 00000100:00100000:1.0:1789635423.242999:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048640 00000100:00100000:1.0:1789635423.243106:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789635423.243116:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422048640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635423.244615:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422048640:12345-0@lo:501:mount.lustre.0 Request processed in 1494us (11506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.244628:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789635423.244640:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789635423.244691:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789635423.244738:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635423.244777:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca5d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635423.244826:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048768 00000100:00100000:2.0:1789635423.244835:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048768 00000100:00100000:2.0:1789635423.244897:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789635423.244906:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422048768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635423.245087:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422048768:12345-0@lo:503:mount.lustre.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.245094:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789635423.245167:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048768:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789635423.245943:0:15887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789635423.246016:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635423.246066:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.246105:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d114a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789635423.246361:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422048896 00000100:00100000:1.0:1789635423.246368:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422048896 00000100:00100000:1.0:1789635423.246404:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789635423.246412:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422048896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789635423.246582:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422048896:12345-0@lo:502:mount.lustre.0 Request processed in 170us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.246590:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789635423.246842:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422048896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789635423.247112:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789635423.247161:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789635423.247210:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789635423.247249:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789635423.247284:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789635423.247541:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789635423.247581:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789635423.247614:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789635423.248261:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635423.248373:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.248408:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d114a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789635423.249128:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049024 00000100:00100000:0.0:1789635423.249137:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049024 00000100:00100000:0.0:1789635423.249185:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789635423.249195:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422049024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789635423.249446:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422049024:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635423.249455:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789635423.249558:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789635423.249694:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789635423.249709:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789635423.250776:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635423.250788:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635423.250790:0:15892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789635423.250798:0:15892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79fe701000 00000020:00000080:2.0:1789635423.250801:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789635423.250808:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635423.250811:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635423.250812:0:15892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789635423.250814:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635423.250816:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635423.250817:0:15892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789635423.250820:0:15892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e79fe701000 00000020:00000080:2.0:1789635423.250822:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789635423.250894:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635423.250897:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635423.250899:0:15892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789635423.250901:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789635423.250903:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635423.250905:0:15892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789635423.250908:0:15892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e79fe701000 00000020:00000080:2.0:1789635423.250910:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789635423.250940:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789635423.250943:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789635423.250944:0:15892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789635423.250947:0:15892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789635423.253381:0:15887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789635423.253422:0:15887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635423.253442:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.253456:0:15887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635423.253521:0:15887:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789635423.253524:0:15887:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e79fe701000 10000000:01000000:0.0:1789635423.253528:0:15887:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e79fe701000 10000000:01000000:0.0:1789635423.253539:0:15887:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789635423.253545:0:15887:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e79fe701000 from 1 10000000:01000000:0.0:1789635423.253547:0:15887:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789635423.253586:0:15887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02050600/0x77332204cfbb3fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.253594:0:15887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e7a02050600/0x77332204cfbb3fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.253606:0:15887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e7a02050600/0x77332204cfbb3fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635423.253632:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789635423.253697:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.253734:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d114a300 going to sleep for 11 seconds 00010000:00010000:2.0:1789635423.256831:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635423.259514:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049152 00000100:00100000:3.0:1789635423.259530:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049152 00000100:00100000:3.0:1789635423.259594:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789635423.259605:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422049152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789635423.259625:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635423.259645:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb3fb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3fb0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.259675:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb3fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3fb0 expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.259686:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676e00/0x77332204cfbb3fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3fb0 expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.259694:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676e00, rc 0) 00000100:00100000:3.0:1789635423.259769:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049152:12345-0@lo:101:mount.lustre.0 Request processed in 166us (6072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.259777:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789635423.261971:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789635423.262003:0:15887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e7a02050600/0x77332204cfbb3fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fb7 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.262016:0:15887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e7a02050600/0x77332204cfbb3fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3fb7 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789635423.262692:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789635423.263145:0:15887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635423.263432:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789635423.263477:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789635423.263512:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789635423.263573:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789635423.263614:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789635423.263675:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789635423.263720:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789635423.263753:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789635423.263794:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789635423.263829:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789635423.263883:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789635423.263933:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789635423.263970:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789635423.264002:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789635423.264049:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789635423.264082:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789635423.264113:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789635423.264159:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789635423.264195:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789635423.264224:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789635423.264264:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789635423.264294:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789635423.264357:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789635423.264409:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789635423.264444:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789635423.264474:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789635423.264519:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789635423.264552:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789635423.264581:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789635423.264625:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789635423.264654:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789635423.264683:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789635423.264714:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789635423.264759:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789635423.264791:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789635423.264830:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789635423.268629:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789635423.268790:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789635423.268799:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789635423.268920:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789635423.268990:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.269032:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d114a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635423.280525:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049280 00000100:00100000:2.0:1789635423.280541:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049280 00000100:00100000:2.0:1789635423.280613:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789635423.280632:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789635423.280950:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049280:12345-0@lo:501:mount.lustre.0 Request processed in 320us (11959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.280959:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789635423.281946:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789635423.282004:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789635423.282057:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.287408:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fe2ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1789635423.288469:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049408 00000100:00100000:2.0:1789635423.288480:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049408 00000100:00100000:2.0:1789635423.288530:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789635423.288540:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789635423.288809:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049408:12345-0@lo:503:mount.lustre.0 Request processed in 269us (6751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.288817:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789635423.292667:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789635423.296969:0:15887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789635423.297067:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635423.297153:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635423.297202:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c71aa240 going to sleep for 11 seconds 00000100:00100000:2.0:1789635423.298073:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049536 00000100:00100000:2.0:1789635423.298085:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049536 00000100:00100000:2.0:1789635423.298139:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789635423.298149:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635423.298579:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049536:12345-0@lo:502:mount.lustre.0 Request processed in 427us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.298588:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789635423.298677:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789635423.298948:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789635423.299000:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789635423.299031:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789635423.299074:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789635423.299127:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789635423.299179:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789635423.299217:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789635423.299249:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789635423.299436:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789635423.299480:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789635423.299516:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789635423.299566:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789635423.299601:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789635423.299627:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789635423.299664:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789635423.299698:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789635423.299731:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789635423.299794:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789635423.299834:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789635423.299879:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789635423.299946:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789635423.299977:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789635423.300004:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789635423.300045:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789635423.300077:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789635423.300108:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789635423.300167:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789635423.300203:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789635423.300238:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789635423.302426:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789635423.302527:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789635423.302562:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789635423.302612:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789635423.302707:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789635423.302748:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789635423.302798:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789635423.302851:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789635423.302906:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789635423.302955:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789635423.302986:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789635423.303036:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789635423.303109:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635423.303156:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c704cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789635423.305268:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049664 00000100:00100000:2.0:1789635423.305298:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049664 00000100:00100000:2.0:1789635423.305385:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789635423.305395:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789635423.305785:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422049664:12345-0@lo:502:mount.lustre.0 Request processed in 389us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.305793:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789635423.306048:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422049664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789635423.306158:0:15887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789635423.306173:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789635423.314989:0:15897:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789635423.315008:0:15897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e79feda19c0) 00000020:00000080:1.0:1789635423.315032:0:15897:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789635423.315123:0:15897:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e79fe701000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789635423.315128:0:15897:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e79fe701000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789635423.315130:0:15897:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e79fe701000 3 00010000:00080000:1.0:1789635423.315172:0:15897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e79fe5fa000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789635423.319842:0:15897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789635423.320144:0:15897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789635423.320181:0:15897:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789635423.320195:0:15897:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x77332204cfbb3fc5 00000100:00080000:1.0:1789635423.320206:0:15897:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789635423.320217:0:15897:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e79fe5fa000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789635423.320252:0:15897:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fe907b80 x1876568422049792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635423.320296:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876568422049792:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789635423.320379:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.320437:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049792 00000100:00100000:1.0:1789635423.320444:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049792 00000100:00100000:1.0:1789635423.320474:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635423.320482:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876568422049792:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789635423.320508:0:14484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:1.0:1789635423.320536:0:14484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x77332204cfbb3fcc 00000004:00100000:1.0:1789635423.320549:0:14484:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789635423.320577:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9e79fdf67000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635423.320623:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876568422049792:12345-0@lo:38:llog_process_th.0 Request processed in 139us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.320642:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789635423.320678:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe907b80 x1876568422049792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789635433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635423.320687:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789635423.320694:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789635423.320700:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789635423.320705:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789635423.320707:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79fe5fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789635423.320712:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876568422049792:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789635423.320729:0:15897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789635423.320771:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789635423.320775:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789635423.320777:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789635423.320780:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:1.0:1789635423.320783:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789635423.320787:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79dc2fd000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789635423.320800:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79fe905c00 x1876568422050048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789635423.320840:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422049920:0@lo:400:kworker.0 00000100:00100000:1.0:1789635423.323483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.323572:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422050048:0@lo:8:kworker.0 00000100:00100000:1.0:1789635423.323607:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.323639:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422050176:0@lo:400:kworker.0 00000100:00100000:1.0:1789635423.323683:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.323705:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789635423.323712:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422050304:0@lo:400:kworker.0 00000100:00100000:1.0:1789635423.323735:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635423.323767:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422049920 00000100:00100000:1.0:1789635423.323775:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422049920 00000100:00100000:1.0:1789635423.323830:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050048 00000100:00100000:1.0:1789635423.323833:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050048 00000100:00100000:1.0:1789635423.323868:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635423.323877:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422049920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635423.323931:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422049920:12345-0@lo:400:kworker.0 Request processed in 55us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.323938:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635423.323957:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635423.323961:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876568422050048:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789635423.324005:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876568422050048:12345-0@lo:8:kworker.0 Request processed in 41us (396us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789635423.324010:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789635423.324029:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050176 00000100:00100000:1.0:1789635423.324032:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050176 00000100:00100000:1.0:1789635423.324053:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050304 00000100:00100000:1.0:1789635423.324055:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050304 00000100:00100000:1.0:1789635423.324070:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789635423.324076:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422050176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635423.324125:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422050176:12345-0@lo:400:kworker.0 Request processed in 48us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.324132:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789635423.324143:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635423.324156:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422050304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635423.324184:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422050304:12345-0@lo:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635423.324190:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789635423.324207:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789635423.324211:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635423.324242:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422049920:0@lo:400:kworker.0 00000100:00100000:1.0:1789635423.324269:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000040:00080000:0.0:1789635423.326054:0:15897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789635423.326167:0:15887:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789635423.326201:0:15887:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789635423.326220:0:15887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02050600/0x77332204cfbb3fb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fb7 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.326233:0:15887:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02050600/0x77332204cfbb3fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fb7 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789635423.326308:0:15887:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789635423.326336:0:15887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635423.326337:0:15887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635423.326339:0:15887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635423.326340:0:15887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635423.326342:0:15887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635423.326343:0:15887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635423.326346:0:15887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635423.326347:0:15887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635423.326351:0:15887:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789635423.326353:0:15887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789635423.326355:0:15887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635423.326356:0:15887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635423.326357:0:15887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635423.326358:0:15887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635423.326360:0:15887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635423.326361:0:15887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635423.326362:0:15887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635423.326363:0:15887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789635423.326390:0:15887:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789635423.326410:0:15887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422050432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789635423.326475:0:15887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.326516:0:15887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d114a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789635423.326766:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050432 00000100:00100000:2.0:1789635423.326778:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050432 00000100:00100000:2.0:1789635423.326828:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789635423.326838:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:15887:x1876568422050432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789635423.326879:0:14476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789635423.326892:0:14476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1789635423.327563:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789635423.327571:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789635423.327575:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422050048:0@lo:8:kworker.0 00010000:00080000:1.0:1789635423.327632:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe905500 x1876568422050304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635423.327646:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422050304:0@lo:400:kworker.0 00010000:00080000:1.0:1789635423.327659:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79fe905f80 x1876568422050176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635423.327667:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422050176:0@lo:400:kworker.0 20000000:01000000:2.0:1789635423.392000:0:14476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789635423.392023:0:14476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789635423.392203:0:14500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789635423.392210:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789635423.392234:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.392253:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.392262:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.392344:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.392359:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 19 pid: 14476 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635423.392375:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876568422050560:0@lo:104: 00000100:00100000:0.0:1789635423.392441:0:14500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635423.392490:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c674f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635423.392634:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050560 00000100:00100000:3.0:1789635423.392643:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050560 00000100:00100000:3.0:1789635423.392710:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635423.392720:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14500:x1876568422050560:12345-0@lo:104: 00010000:00010000:3.0:1789635423.392734:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.392795:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789635423.392802:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:14500:x1876568422050560:12345-0@lo:104: Request processed in 84us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.392809:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789635423.392831:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635423.392837:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.392872:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85800 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635423.392876:0:14473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.392885:0:14473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635423.392892:0:14473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635423.392899:0:14473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789635423.392929:0:14473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.392935:0:14473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635423.392956:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.392964:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b85800/0x77332204cfbb3e9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3ea6 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.392982:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635423.392984:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635423.392985:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635423.393004:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422050688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635423.393032:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635423.393070:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050688 00000100:00100000:3.0:1789635423.393074:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050688 00010000:00010000:3.0:1789635423.393092:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 20 pid: 14476 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635423.393123:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635423.393130:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+20:3306:x1876568422050688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635423.393141:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635423.393147:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 20 pid: 14476 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393157:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 20 pid: 14476 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393172:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393180:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789635423.393193:0:14469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010607789s 00010000:00010000:3.0:1789635423.393197:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393203:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393210:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393217:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393222:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7a02050800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635423.393232:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393240:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393248:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635423.393258:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635423.393285:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+20:3306:x1876568422050688:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635423.393291:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789635423.393364:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422050688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789635423.393556:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe820000/0x77332204cfbb3ea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb3e9f expref: 19 pid: 14476 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635423.393567:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876568422050560:0@lo:104: 00010000:00010000:0.0:1789635423.393582:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.393590:0:14500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.393596:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635423.393608:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02050800/0x77332204cfbb3fd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635423.438545:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:15887:x1876568422050432:12345-0@lo:253:mount.lustre.0 Request processed in 111700us (112060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635423.438562:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789635423.438651:0:15887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b8229a1b-c2b6-4ba8-903c-807c449e978b:15887:1876568422050432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789635423.438792:0:15887:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789635423.438797:0:15887:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789635423.438799:0:15887:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789635423.438800:0:15887:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789635423.438801:0:15887:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789635423.438802:0:15887:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789635423.438803:0:15887:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789635423.438805:0:15887:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789635423.438807:0:15887:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789635423.438808:0:15887:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789635423.438823:0:15887:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789635423.448307:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789635423.448514:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789635423.448644:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789635423.453195:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789635423.453550:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789635423.453893:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789635423.455085:0:15887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789635423.657912:0:15887:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789635423.657921:0:15887:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789635423.657963:0:15887:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789635423.658029:0:15887:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789635423.658043:0:15887:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789635423.658075:0:15887:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789635424.275454:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789635424.851779:0:14481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789635424.851786:0:14481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e79e734d800 from 8 10000000:01000000:0.0:1789635424.851791:0:14481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789635424.851849:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02051600/0x77332204cfbb3fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635424.851863:0:14481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e7a02051600/0x77332204cfbb3fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635424.851876:0:14481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e7a02051600/0x77332204cfbb3fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635424.851900:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422050816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635424.851965:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635424.852023:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca7230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635424.852345:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050816 00000100:00100000:3.0:1789635424.852355:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050816 00000100:00100000:3.0:1789635424.852403:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789635424.852413:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:14481:x1876568422050816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635424.852426:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635424.852442:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79c1676c00/0x77332204cfbb3fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb3fda expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635424.854443:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79c1676c00/0x77332204cfbb3fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb3fda expref: 19 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635424.857412:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79c1676c00/0x77332204cfbb3fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3fda expref: 19 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635424.857426:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79c1676c00, rc 0) 00000100:00100000:3.0:1789635424.857513:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422050816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5101us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635424.857523:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789635424.860715:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422050816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635424.860762:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e7a02051600/0x77332204cfbb3fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fe1 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635424.860775:0:14481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e7a02051600/0x77332204cfbb3fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb3fe1 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635424.860860:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422050944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789635424.860938:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635424.860993:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79ca7230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635424.861059:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422050944 00000100:00100000:2.0:1789635424.861067:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422050944 00000100:00100000:2.0:1789635424.861129:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789635424.861139:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422050944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789635424.861161:0:14476:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789635424.861178:0:14476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789635424.861182:0:14476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789635424.861271:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422050944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635424.861279:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789635424.861990:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422050944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789635424.862072:0:14481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789635424.862080:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e7a02051600/0x77332204cfbb3fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fe1 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635424.862090:0:14481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e7a02051600/0x77332204cfbb3fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb3fe1 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635425.047295:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635425.047343:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422051072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635425.047411:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635425.047485:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051072 00000100:00100000:1.0:1789635425.047498:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051072 00000100:00100000:1.0:1789635425.047563:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789635425.047572:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422051072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635425.047608:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789635425.047610:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635425.047659:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422051072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635425.047665:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635425.047786:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422051072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789635425.299495:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635426.323481:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635427.348471:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.387136:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789635428.638880:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789635428.638888:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789635428.638891:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789635428.638909:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e79dc2fd000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789635428.638930:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e79e7efed80 x1876568422051456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789635428.639012:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422051328:0@lo:400:kworker.0 00000100:00100000:3.0:1789635428.639088:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635428.639150:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789635428.639157:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8229a1b-c2b6-4ba8-903c-807c449e978b:3309:1876568422051200:0@lo:400:kworker.0 00000100:00100000:3.0:1789635428.639186:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635428.639210:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422051840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635428.639216:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422051584:0@lo:400:kworker.0 00000100:00100000:3.0:1789635428.639235:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635428.639262:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422051456:0@lo:8:kworker.0 00000100:00100000:2.0:1789635428.639266:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635428.639285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635428.639299:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789635428.639331:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422051712:0@lo:400:kworker.0 00000100:00100000:3.0:1789635428.639334:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051328 00000100:00100000:3.0:1789635428.639343:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051328 00000100:00100000:2.0:1789635428.639354:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635428.639378:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051840 00000100:00100000:2.0:1789635428.639381:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051840 00000100:00100000:3.0:1789635428.639392:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051456 00000100:00100000:3.0:1789635428.639395:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051456 00000100:00100000:2.0:1789635428.639402:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051584 00000100:00100000:2.0:1789635428.639404:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051584 00000100:00100000:3.0:1789635428.639411:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789635428.639415:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051712 00000100:00100000:2.0:1789635428.639417:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051712 00000100:00100000:3.0:1789635428.639421:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422051328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635428.639429:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789635428.639433:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422051840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635428.639471:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422051840:12345-0@lo:400:kworker.0 Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635428.639478:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789635428.639495:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635428.639501:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422051584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635428.639520:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635428.639526:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876568422051456:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789635428.639530:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422051584:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635428.639535:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789635428.639546:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789635428.639551:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422051712:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789635428.639555:0:15169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 404 last 0 00000100:00100000:2.0:1789635428.639575:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876568422051712:12345-0@lo:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635428.639581:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:0.0:1789635428.639591:0:15169:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x77332204cfbb3fe8 00000100:00080000:2.0:1789635428.639594:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789635428.639598:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1789635428.639607:0:15169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e79ec733800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789635428.639612:0:15169:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789635428.639615:0:15169:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1789635428.639626:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7efd500 x1876568422051712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635428.639651:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876568422051712:0@lo:400:kworker.0 00010000:00080000:2.0:1789635428.639662:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7efe300 x1876568422051584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635428.639669:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422051584:0@lo:400:kworker.0 00002000:00080000:0.0:1789635428.640143:0:15169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789635428.640169:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9e79ec737000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635428.640218:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876568422051456:12345-0@lo:8:kworker.0 Request processed in 691us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635428.640225:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789635428.640258:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7efed80 x1876568422051456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789635453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789635428.640271:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789635428.640286:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789635428.640292:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789635428.640294:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e79dc2fd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789635428.640306:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789635428.640325:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876568422051456:0@lo:8:kworker.0 00000100:00100000:3.0:1789635428.640484:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422051328:12345-0@lo:400:kworker.0 Request processed in 1062us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.640491:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789635428.640515:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051200 00000100:00100000:3.0:1789635428.640519:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051200 00000100:00100000:3.0:1789635428.640548:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789635428.640554:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3309:x1876568422051200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635428.640585:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3309:x1876568422051200:12345-0@lo:400:kworker.0 Request processed in 32us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.640590:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789635428.644510:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79e7eff800 x1876568422051840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789635428.644529:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422051840:0@lo:400:kworker.0 00000100:00100000:2.0:1789635428.644553:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422051328:0@lo:400:kworker.0 00000100:00100000:2.0:1789635428.644583:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422051968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635428.644640:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635428.644677:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8229a1b-c2b6-4ba8-903c-807c449e978b:3309:1876568422051200:0@lo:400:kworker.0 00000100:00100000:1.0:1789635428.647915:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422051968 00000100:00100000:1.0:1789635428.647933:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422051968 00000100:00100000:1.0:1789635428.648007:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789635428.648018:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422051968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635428.648058:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635428.648146:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422051968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635428.648153:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789635428.648174:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789635428.648211:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dba5f480 x1876568422051968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789635444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635428.648232:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422051968:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1789635428.649363:0:14508:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789635428.649893:0:14508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404469580513ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789635428.656230:0:14509:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789635428.656299:0:14509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe905500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876568422052096:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789635428.656381:0:14509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635428.656410:0:14509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492840 going to sleep for 11 seconds 00000100:00100000:2.0:1789635428.661055:0:15593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052096 00000100:00100000:2.0:1789635428.661072:0:15593:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052096 00000100:00100000:2.0:1789635428.661135:0:15593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789635428.661146:0:15593:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14509:x1876568422052096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789635428.678440:0:15593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789635428.678461:0:15593:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789635428.678467:0:15593:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789635428.697116:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789635428.697132:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.697150:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1789635428.697161:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635428.697167:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.697187:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.697198:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.697206:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.697228:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635428.697241:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.697247:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.697255:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.697260:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.697269:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.698985:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.699013:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e623dd2b/0x77332204cfbb3fef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.699034:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.699037:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.699038:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789635428.702087:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789635428.702101:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.702119:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1789635428.702124:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635428.702131:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.702146:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.702157:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.702166:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.703079:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789635428.705686:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635428.705698:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.705725:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635428.705731:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.705743:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.705775:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.705783:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000193b5074/0x77332204cfbb3ff6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.705806:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.705808:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.705810:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789635428.706384:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789635428.707499:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.707509:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.707524:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.707529:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.707535:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.707549:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.708827:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.708843:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.708872:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789635428.709699:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.709716:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.709727:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.709733:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.709744:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.709775:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.709782:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e53bb895/0x77332204cfbb3ffd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.709803:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.709805:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.709806:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635428.709966:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.709973:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.709984:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.709988:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.709994:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710006:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710015:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710023:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710060:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635428.710480:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.710486:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710496:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.710499:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.710504:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710514:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710523:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710532:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710545:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789635428.710935:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.710941:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710950:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.710959:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.710964:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710974:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710983:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.710991:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.711000:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789635428.711405:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.711410:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.711418:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.711422:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.711425:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.711433:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.711441:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.711454:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.711462:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789635428.713356:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789635428.713370:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713384:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.713390:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713414:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713437:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713446:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882d3b72/0x77332204cfbb4004 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713470:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789635428.713475:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713482:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.713485:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713494:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713505:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713512:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ae2004/0x77332204cfbb400b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713537:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635428.713541:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713548:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.713552:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713575:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713587:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713595:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc92f82a/0x77332204cfbb4012 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713609:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.713613:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713620:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.713623:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713642:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713653:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713661:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aabc9444/0x77332204cfbb4019 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.713674:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.713676:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.713678:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.713686:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635428.714057:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.714065:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714079:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.714083:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.714091:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714103:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714113:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714121:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714183:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635428.714724:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.714731:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714747:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.714750:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.714766:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714778:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714787:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.714795:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.715991:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635428.716005:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716017:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.716022:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716032:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716052:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716070:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058af44ab/0x77332204cfbb4020 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716095:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.716099:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716105:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.716109:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716116:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716123:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.716129:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.716131:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.716133:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.716270:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.716278:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080861680/0x77332204cfbb4027 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.716869:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.716876:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.716888:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.716892:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.716899:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.716922:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.716932:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.716940:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717093:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.717099:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717108:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.717117:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717126:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717141:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717150:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.717151:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.717153:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.717218:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.717224:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f06faa4/0x77332204cfbb402e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.717725:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.717732:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.717742:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.717745:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.717750:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.717769:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.717788:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.717795:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717867:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.717872:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717880:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1677800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.717883:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717890:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717902:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.717909:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.717915:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.717918:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.717979:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.717984:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068741ba2/0x77332204cfbb4035 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.718422:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.718429:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.718438:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.718441:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.718446:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.718456:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.718464:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.718481:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.719486:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.719495:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.719506:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.719511:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.719520:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.719536:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.719546:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.719547:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.719549:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.719644:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.719652:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7275983/0x77332204cfbb403c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.720172:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.720179:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720190:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.720194:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.720199:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720211:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720219:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720227:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720360:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635428.720822:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.720828:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720837:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.720840:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.720844:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720853:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720861:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.720868:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.720928:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789635428.720934:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.720941:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635428.720945:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.720952:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.720968:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.720976:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094c8e41c/0x77332204cfbb4043 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.720992:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635428.720995:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721012:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635428.721015:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721022:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721032:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721039:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.721040:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.721042:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.721093:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.721155:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.721160:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b878df0/0x77332204cfbb404a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.721667:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.721674:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.721688:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.721691:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.721696:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.721706:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.721715:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.721723:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721782:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635428.721788:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721796:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635428.721799:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721806:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721818:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.721832:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.721834:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.721835:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.721940:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.721945:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794f9d55/0x77332204cfbb4051 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.722398:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.722404:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.722413:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.722416:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.722422:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.722442:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.722451:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.722459:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.722508:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.722515:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.722523:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.722526:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.722546:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.722559:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.722984:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.722986:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.722988:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.723052:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.723058:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7fa0839/0x77332204cfbb4058 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.723525:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.723531:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.723541:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.723544:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.723550:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.723561:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.723743:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.723751:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.723805:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635428.723811:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.723819:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635428.723823:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.723831:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.723845:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.723853:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.723854:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.723855:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.724095:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.724101:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ebd863a/0x77332204cfbb405f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.724866:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.724873:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.724885:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.724889:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.724895:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.724907:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.724916:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.724934:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.724981:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.724988:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.724996:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.725000:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.725008:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.725022:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.725031:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.725032:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.725034:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.725151:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.725156:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000976451de/0x77332204cfbb4066 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.725781:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.725787:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.725796:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.725799:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.725804:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.725815:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.725824:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.725831:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.725896:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789635428.725903:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.725911:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635428.725915:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.725929:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.725942:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635428.725950:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.725951:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789635428.725953:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.726015:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.726020:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffac83ba/0x77332204cfbb406d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.726477:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.726484:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.726494:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.726497:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.726502:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.726511:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.726519:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.726527:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.726844:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.726851:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.726859:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.726863:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.726871:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.726885:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.726893:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.726895:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.726896:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.726944:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.726950:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ce14e4b/0x77332204cfbb4074 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.727438:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.727444:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.727454:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.727458:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.727463:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.727472:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.727480:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.727488:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.727500:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635428.727959:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.727965:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.727973:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.727976:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.727989:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.727998:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728006:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728013:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728020:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789635428.728206:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635428.728213:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728221:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.728226:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728235:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728261:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728269:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a95b6c7c/0x77332204cfbb407b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728286:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.728290:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728297:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.728300:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728308:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728333:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728341:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000691b81db/0x77332204cfbb4082 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.728353:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.728355:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.728362:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.728370:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789635428.728768:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.728775:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728785:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.728788:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.728793:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728801:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728809:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728826:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.728884:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789635428.729299:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.729305:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.729341:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.729345:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.729350:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.729359:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.729366:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.729372:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729672:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789635428.729678:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729686:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.729690:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729698:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729712:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729719:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a54fab3f/0x77332204cfbb4089 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729736:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.729739:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729744:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.729747:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729776:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729785:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.729793:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.729794:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.729796:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.729859:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.729864:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd689cfb/0x77332204cfbb4090 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.730412:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.730419:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.730430:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.730434:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.730439:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.730450:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.730459:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.730468:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.730512:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.730518:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.730525:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218c00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.730528:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.730536:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.730548:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.730556:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.730557:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.730559:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.730701:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.730707:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7aaf35d/0x77332204cfbb4097 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.731133:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.731138:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.731157:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.731160:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.731164:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.731174:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.731182:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.731189:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.731217:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.731222:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.731230:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219c00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.731233:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.731241:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.731253:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.731261:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.731262:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.731264:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.731399:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.731404:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000debf0cca/0x77332204cfbb409e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789635428.731996:0:15593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789635428.732002:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.732011:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1789635428.732014:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635428.732019:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.732037:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.732045:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635428.732052:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.732080:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789635428.732085:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.732093:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635428.732106:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.732115:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.732137:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635428.732145:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.732147:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789635428.732148:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635428.732649:0:15593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789635428.732655:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f6e029e/0x77332204cfbb40a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789635428.732908:0:15593:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789635428.733069:0:15593:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14509:x1876568422052096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 71920us (76682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635428.733080:0:15593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635428.733177:0:14509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe905500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876568422052096:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789635428.733195:0:14509:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789635428.733243:0:14509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876568422052224:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789635428.733278:0:14509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635428.733340:0:14509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c3f26b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789635428.733412:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052224 00000100:00100000:3.0:1789635428.733420:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052224 00000100:00100000:3.0:1789635428.733461:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789635428.733470:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14509:x1876568422052224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789635428.733510:0:15170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1789635428.739881:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635428.748118:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14509:x1876568422052224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14641us (14831us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789635428.748133:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635428.749150:0:14509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876568422052224:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789635428.749169:0:14509:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1789635429.400831:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635430.166127:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789635430.166158:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422052352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635430.166227:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635430.166292:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052352 00000100:00100000:1.0:1789635430.166300:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052352 00000100:00100000:1.0:1789635430.166379:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635430.166389:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422052352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635430.166423:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635430.166470:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422052352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635430.166476:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789635430.166509:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635430.166542:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422052352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789635430.419418:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789635431.069209:0:16244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1789635431.316958:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789635431.443460:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635432.480116:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635433.344585:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.344828:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410528896 00000100:00100000:3.0:1789635433.344854:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410528896 00000100:00100000:3.0:1789635433.344903:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:3.0:1789635433.344911:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2347:x1876568410528896:12345-192.168.201.30@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789635433.344942:0:14479:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e9cc2b2b-9937-4a26-8ec8-02b005c41d88@192.168.201.30@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:3.0:1789635433.344974:0:14479:0:(genops.c:1384:class_connect()) connect: client e9cc2b2b-9937-4a26-8ec8-02b005c41d88, cookie 0x77332204cfbb40ac 00000100:00080000:3.0:1789635433.345133:0:14479:0:(import.c:65:import_set_state_nolock()) ffff9e79c3919800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635433.345243:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+5:2347:x1876568410528896:12345-192.168.201.30@tcp:250:mount.lustre.0 Request processed in 330us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.345251:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:2.0:1789635433.354538:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.354619:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529024 00000100:00100000:0.0:1789635433.354630:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529024 00000100:00100000:0.0:1789635433.354697:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:0.0:1789635433.354708:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+5:13727:x1876568410529024:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635433.354725:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635433.354747:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02050e00/0x77332204cfbb40b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d414 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635433.354791:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02050e00/0x77332204cfbb40b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d414 expref: 6 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635433.354801:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02050e00/0x77332204cfbb40b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d414 expref: 6 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635433.354810:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02050e00, rc 0) 00000100:00100000:0.0:1789635433.354874:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+6:13727:x1876568410529024:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 168us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.354881:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:2.0:1789635433.357389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.357527:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529152 00000100:00100000:0.0:1789635433.357541:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529152 00000100:00100000:0.0:1789635433.357604:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:0.0:1789635433.357615:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+6:13727:x1876568410529152:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789635433.357972:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+6:13727:x1876568410529152:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 357us (591us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635433.357981:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:2.0:1789635433.364503:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.364585:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529280 00000100:00100000:0.0:1789635433.364597:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529280 00000100:00100000:0.0:1789635433.364655:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:0.0:1789635433.364682:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+6:13727:x1876568410529280:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635433.364699:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635433.364719:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02050800/0x77332204cfbb40ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d41b expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635433.364749:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02050800/0x77332204cfbb40ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d41b expref: 7 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635433.364776:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02050800/0x77332204cfbb40ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d41b expref: 7 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635433.364786:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02050800, rc 0) 00000100:00100000:0.0:1789635433.364850:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+7:13727:x1876568410529280:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 177us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.364856:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1789635433.366584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.366631:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529408 00000100:00100000:0.0:1789635433.366639:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529408 00000100:00100000:0.0:1789635433.366703:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:0.0:1789635433.366712:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+7:13727:x1876568410529408:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789635433.368466:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13727:x1876568410529408:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 1746us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.368481:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:2.0:1789635433.392566:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.393714:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529536 00000100:00100000:0.0:1789635433.393731:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529536 00000100:00100000:0.0:1789635433.393795:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1789635433.393807:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13727:x1876568410529536:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789635433.394226:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13727:x1876568410529536:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 421us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.394233:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1789635433.402281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.403098:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529664 00000100:00100000:3.0:1789635433.403113:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529664 00000100:00100000:3.0:1789635433.403179:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:3.0:1789635433.403191:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c8a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13746:x1876568410529664:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635433.403792:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c8a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13746:x1876568410529664:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 602us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.403802:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:1.0:1789635433.451424:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.451522:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529792 00000100:00100000:3.0:1789635433.451534:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529792 00000100:00100000:3.0:1789635433.451582:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:3.0:1789635433.451593:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13746:x1876568410529792:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635433.451935:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13746:x1876568410529792:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 342us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.451945:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:2.0:1789635433.466489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.466582:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410529920 00000100:00100000:3.0:1789635433.466593:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410529920 00000100:00100000:3.0:1789635433.466647:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:3.0:1789635433.466681:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+8:13727:x1876568410529920:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789635433.466702:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635433.466718:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e78c2218800/0x77332204cfbb40c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d445 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.466742:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e78c2218800/0x77332204cfbb40c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d445 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.466751:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e78c2218800/0x77332204cfbb40c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d445 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.466758:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2218800, rc 0) 00000100:00100000:3.0:1789635433.466813:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+9:13727:x1876568410529920:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 144us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.466818:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:1.0:1789635433.473737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.474121:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530048 00000100:00100000:0.0:1789635433.474133:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530048 00000100:00100000:0.0:1789635433.474191:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:0.0:1789635433.474227:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+9:13727:x1876568410530048:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789635433.474257:0:14476:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789635433.474276:0:14476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789635433.474280:0:14476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789635433.474284:0:14476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789635433.474286:0:14476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789635433.477492:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+9:13727:x1876568410530048:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 3256us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.477506:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:2.0:1789635433.483009:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.483103:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530176 00000100:00100000:3.0:1789635433.483117:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530176 00000100:00100000:3.0:1789635433.483190:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1789635433.483203:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+9:13727:x1876568410530176:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789635433.483232:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635433.483250:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d44c expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.483282:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.483297:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635433.483367:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2219c00, rc 0) 00000100:00100000:3.0:1789635433.483431:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13727:x1876568410530176:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 231us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.483438:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:1.0:1789635433.486423:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.486786:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530304 00000100:00100000:0.0:1789635433.486798:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530304 00000100:00100000:0.0:1789635433.486859:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:0.0:1789635433.486871:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13727:x1876568410530304:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789635433.487898:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13727:x1876568410530304:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 1023us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.487909:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:1.0:1789635433.489838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.489948:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530432 00000100:00100000:3.0:1789635433.489959:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530432 00000100:00100000:3.0:1789635433.490012:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:3.0:1789635433.490021:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13727:x1876568410530432:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789635433.490579:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13727:x1876568410530432:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 556us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.490588:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00010000:00010000:2.0:1789635433.491571:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635433.494454:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635433.496667:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530560 00000100:00100000:0.0:1789635433.496696:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530560 00000100:00100000:0.0:1789635433.496788:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:0.0:1789635433.496805:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13748:x1876568410530560:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635433.497167:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13748:x1876568410530560:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 368us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.497177:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:1.0:1789635433.506076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.506256:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530688 00000100:00100000:3.0:1789635433.506267:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530688 00000100:00100000:3.0:1789635433.506366:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:3.0:1789635433.506377:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13748:x1876568410530688:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635433.506660:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13748:x1876568410530688:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 284us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.506668:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1789635433.525013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635433.525361:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530816 00000100:00100000:2.0:1789635433.525376:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530816 00000100:00100000:2.0:1789635433.525431:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789635433.525441:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1876568410530816:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789635433.525474:0:14484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3c242a26-81b5-4d10-8aab-35c76a4f1728@192.168.201.30@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:2.0:1789635433.525577:0:14484:0:(genops.c:1384:class_connect()) connect: client 3c242a26-81b5-4d10-8aab-35c76a4f1728, cookie 0x77332204cfbb40cf 00000004:00100000:2.0:1789635433.525616:0:14484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789635433.525622:0:14484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789635433.612385:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9e79c93f7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789635433.614141:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2347:x1876568410530816:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 88686us (89127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635433.614160:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1789635433.629710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635433.629826:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635433.629994:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410530944 00000100:00100000:2.0:1789635433.630010:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410530944 00000100:00100000:2.0:1789635433.630099:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531072 00000100:00100000:2.0:1789635433.630103:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531072 00000100:00100000:2.0:1789635433.630121:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789635433.630135:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:0:x1876568410530944:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789635433.630199:0:14486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789635433.630338:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:0:x1876568410530944:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 206us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.630347:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789635433.630367:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789635433.630375:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13727:x1876568410531072:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789635433.630387:0:14486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789635433.630424:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13727:x1876568410531072:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 50us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.630431:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00080000:1.0:1789635433.631253:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635433.633718:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635433.633902:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531200 00000100:00100000:2.0:1789635433.633921:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531200 00000100:00100000:2.0:1789635433.634003:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789635433.634017:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13727:x1876568410531200:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789635433.634155:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13727:x1876568410531200:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 141us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.634185:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789635433.641152:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635433.641208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635433.641260:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635433.641360:0:15593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531328 00000100:00100000:3.0:1789635433.641376:0:15593:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531328 00000100:00100000:3.0:1789635433.641445:0:15593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531456 00000100:00100000:3.0:1789635433.641449:0:15593:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531456 00000100:00100000:3.0:1789635433.641485:0:15593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789635433.641496:0:15593:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1876568410531328:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789635433.641567:0:15593:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3c242a26-81b5-4d10-8aab-35c76a4f1728@192.168.201.30@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:3.0:1789635433.641615:0:15593:0:(genops.c:1384:class_connect()) connect: client 3c242a26-81b5-4d10-8aab-35c76a4f1728, cookie 0x77332204cfbb40d6 00002000:00100000:3.0:1789635433.641632:0:15593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c242a26-81b5-4d10-8aab-35c76a4f1728/ffff9e79c391e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789635433.641903:0:15593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789635433.642542:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789635433.642552:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1876568410531456:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789635433.642592:0:15169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c242a26-81b5-4d10-8aab-35c76a4f1728@192.168.201.30@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:0.0:1789635433.642618:0:15169:0:(genops.c:1384:class_connect()) connect: client 3c242a26-81b5-4d10-8aab-35c76a4f1728, cookie 0x77332204cfbb40dd 00002000:00100000:0.0:1789635433.642627:0:15169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c242a26-81b5-4d10-8aab-35c76a4f1728/ffff9e79ec731000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635433.642647:0:15169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635433.643620:0:15169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789635433.643847:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9e79ec730800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789635433.644216:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2347:x1876568410531456:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 1660us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.644229:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789635433.644893:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531584 00000100:00100000:2.0:1789635433.644907:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531584 00000100:00100000:2.0:1789635433.644976:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789635433.644988:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13727:x1876568410531584:12345-192.168.201.30@tcp:33:mount.lustre.0 00002000:00080000:3.0:1789635433.645950:0:15593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789635433.646013:0:15593:0:(import.c:65:import_set_state_nolock()) ffff9e79d0484800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635433.646094:0:15593:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2347:x1876568410531328:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 4594us (4880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.646105:0:15593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000004:00080000:2.0:1789635433.650656:0:14487:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5576us 00000004:00200000:3.0:1789635433.709452:0:14487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789635433.709626:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13727:x1876568410531584:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 64630us (68483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635433.709645:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1789635433.748634:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422052864:0@lo:400:kworker.0 00000100:00100000:3.0:1789635433.748761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635433.748852:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635433.748860:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422052480:0@lo:400:kworker.0 00000100:00100000:3.0:1789635433.748895:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635433.752298:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422052608:0@lo:400:kworker.0 00000100:00100000:0.0:1789635433.752430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635433.752491:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789635433.752501:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422052736:0@lo:400:kworker.0 00000100:00100000:0.0:1789635433.752528:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635433.752570:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052480 00000100:00100000:0.0:1789635433.752581:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052480 00000100:00100000:0.0:1789635433.752646:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789635433.752655:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3306:x1876568422052480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635433.752917:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3306:x1876568422052480:12345-0@lo:400:kworker.0 Request processed in 262us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.752927:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789635433.753485:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052608 00000100:00100000:0.0:1789635433.753494:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052608 00000100:00100000:0.0:1789635433.753549:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052736 00000100:00100000:0.0:1789635433.753553:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052736 00000100:00100000:0.0:1789635433.753579:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789635433.753596:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422052608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635433.753647:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422052608:12345-0@lo:400:kworker.0 Request processed in 53us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635433.753654:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789635433.754834:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052864 00000100:00100000:2.0:1789635433.754846:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052864 00000100:00100000:2.0:1789635433.754902:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789635433.754911:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422052864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635433.754980:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422052864:12345-0@lo:400:kworker.0 Request processed in 71us (6230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.754988:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789635433.755734:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789635433.755759:0:15167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422052736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635433.755816:0:15167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876568422052736:12345-0@lo:400:kworker.0 Request processed in 73us (3287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635433.755823:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789635433.755846:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635433.755852:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635433.755950:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422052992:0@lo:400:kworker.0 00000100:00100000:1.0:1789635433.755990:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635433.756033:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422052992 00000100:00100000:1.0:1789635433.756039:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422052992 00000100:00100000:1.0:1789635433.756073:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635433.756080:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422052992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635433.756112:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422052992:12345-0@lo:400:kworker.0 Request processed in 32us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635433.756118:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789635433.756132:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789635433.756139:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422053120:0@lo:400:kworker.0 00000100:00100000:1.0:1789635433.756162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635433.756183:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422053120 00000100:00100000:1.0:1789635433.756186:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422053120 00000100:00100000:1.0:1789635433.756207:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789635433.756212:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422053120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635433.756242:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422053120:12345-0@lo:400:kworker.0 Request processed in 29us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635433.756256:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789635433.756271:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789635433.756297:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dc2c8000 x1876568422053120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635433.756333:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422053120:0@lo:400:kworker.0 00010000:00080000:1.0:1789635433.756361:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dba5f480 x1876568422052992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789635433.756370:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422052992:0@lo:400:kworker.0 00000100:00100000:1.0:1789635433.756416:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422052736:0@lo:400:kworker.0 00000100:00100000:1.0:1789635433.756429:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422052608:0@lo:400:kworker.0 00000100:00100000:0.0:1789635433.757997:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422053248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635433.758086:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635433.759513:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422053248 00000100:00100000:2.0:1789635433.759532:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422053248 00000100:00100000:2.0:1789635433.759606:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635433.759617:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568422053248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789635433.759648:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789635433.760967:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876568422053248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1037us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.760985:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789635433.761131:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422053248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635433.771956:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422052480:0@lo:400:kworker.0 00010000:00080000:0.0:1789635433.771988:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e79dba5dc00 x1876568422052864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789635449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789635433.772004:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422052864:0@lo:400:kworker.0 00000001:00100000:0.0:1789635433.925594:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c242a26-81b5-4d10-8aab-35c76a4f1728 00000001:00100000:0.0:1789635433.925616:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789635433.925885:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1789635433.981537:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635433.981744:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531712 00000100:00100000:2.0:1789635433.981762:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531712 00000100:00100000:2.0:1789635433.981840:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1789635433.981852:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13769:x1876568410531712:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:2.0:1789635433.981909:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635433.981943:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb40e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d476 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635433.982040:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb40eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635433.982059:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb40eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635433.982084:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb40eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635433.982134:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789635433.982139:0:14486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635433.982206:0:14486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb40eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635433.982239:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb40e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d476 expref: 8 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635433.982261:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb40eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d476 expref: 7 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635433.982270:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635433.982274:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635433.982278:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821200, rc 0) 00000100:00100000:2.0:1789635433.982460:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:13769:x1876568410531712:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 610us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635433.982478:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:3.0:1789635434.515571:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635435.283550:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422053376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635435.283622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635435.283826:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422053376 00000100:00100000:1.0:1789635435.283836:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422053376 00000100:00100000:1.0:1789635435.283906:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789635435.283916:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422053376:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789635435.283938:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789635435.283954:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635435.284010:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422053376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635435.284017:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635435.284188:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422053376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789635435.539608:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635436.189924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635436.190861:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531840 00000100:00100000:1.0:1789635436.190875:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531840 00000100:00100000:1.0:1789635436.190960:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789635436.190973:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:13821:x1876568410531840:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:1.0:1789635436.191020:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789635436.191130:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:13821:x1876568410531840:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 160us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635436.191137:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:2.0:1789635436.191353:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635436.220094:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635436.220279:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410531968 00000100:00100000:0.0:1789635436.220291:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410531968 00000100:00100000:0.0:1789635436.220395:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1789635436.220409:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13821:x1876568410531968:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:0.0:1789635436.220453:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789635436.220558:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:13821:x1876568410531968:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 152us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.220582:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00080000:2.0:1789635436.221343:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635436.228645:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635436.228743:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532096 00000100:00100000:1.0:1789635436.228834:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532096 00000100:00080000:2.0:1789635436.229009:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789635436.229169:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1789635436.229183:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:13821:x1876568410532096:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1789635436.229230:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635436.229349:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:13821:x1876568410532096:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 169us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635436.229358:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000001:00100000:2.0:1789635436.431550:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c242a26-81b5-4d10-8aab-35c76a4f1728 00010000:00010000:3.0:1789635436.568152:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635436.664632:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635436.664764:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532224 00000100:00100000:0.0:1789635436.664778:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532224 00000100:00100000:0.0:1789635436.664861:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:0.0:1789635436.664874:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+10:13856:x1876568410532224:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635436.664895:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635436.664920:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02050000/0x77332204cfbb40f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d47d expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635436.664953:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02050000/0x77332204cfbb40f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d47d expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635436.664967:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02050000/0x77332204cfbb40f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d47d expref: 11 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635436.664977:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02050000, rc 0) 00000100:00100000:0.0:1789635436.665050:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13856:x1876568410532224:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 178us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.665058:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:2.0:1789635436.673160:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.673520:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532352 00000100:00100000:3.0:1789635436.673533:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532352 00000100:00100000:3.0:1789635436.673599:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:3.0:1789635436.673609:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13856:x1876568410532352:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789635436.674461:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13856:x1876568410532352:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 849us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.674479:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:1.0:1789635436.706792:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635436.716235:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532480 00000100:00100000:2.0:1789635436.716253:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532480 00000100:00100000:2.0:1789635436.716544:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:2.0:1789635436.716557:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13856:x1876568410532480:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789635436.716877:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13856:x1876568410532480:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 322us (10093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635436.716885:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:1.0:1789635436.727836:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.728116:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532608 00000100:00100000:3.0:1789635436.728128:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532608 00000100:00100000:3.0:1789635436.728182:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1789635436.728191:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13861:x1876568410532608:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635436.728589:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13861:x1876568410532608:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 397us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.728598:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:1.0:1789635436.741724:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635436.741828:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532736 00000100:00100000:0.0:1789635436.741840:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532736 00000100:00100000:0.0:1789635436.741900:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:0.0:1789635436.741912:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fb961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13861:x1876568410532736:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789635436.742245:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fb961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13861:x1876568410532736:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 335us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.742264:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:1.0:1789635436.751925:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635436.752458:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532864 00000100:00100000:2.0:1789635436.752471:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532864 00000100:00100000:2.0:1789635436.752533:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:2.0:1789635436.752544:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13856:x1876568410532864:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789635436.752564:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635436.752583:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe821000/0x77332204cfbb40f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4a7 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635436.752623:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821000/0x77332204cfbb40f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4a7 expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635436.752654:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe821000/0x77332204cfbb40f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4a7 expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635436.752663:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821000, rc 0) 00000100:00100000:2.0:1789635436.752724:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13856:x1876568410532864:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 181us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635436.752731:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:1.0:1789635436.760010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.760101:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410532992 00000100:00100000:3.0:1789635436.760113:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410532992 00000100:00100000:3.0:1789635436.760176:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:3.0:1789635436.760187:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13856:x1876568410532992:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789635436.760215:0:14478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789635436.760247:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789635436.760252:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789635436.760255:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789635436.760258:0:14478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789635436.769149:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13856:x1876568410532992:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 8952us (9137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.769166:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:1.0:1789635436.773065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635436.773719:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410533120 00000100:00100000:0.0:1789635436.773733:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410533120 00000100:00100000:0.0:1789635436.774098:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:0.0:1789635436.774110:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13856:x1876568410533120:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789635436.774134:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635436.774160:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4ae expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635436.774200:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 13 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635436.774212:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 13 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635436.774241:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7a02051e00, rc 0) 00000100:00100000:0.0:1789635436.774344:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13856:x1876568410533120:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 236us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.774351:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:1.0:1789635436.778429:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.778681:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410533248 00000100:00100000:3.0:1789635436.778693:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410533248 00000100:00100000:3.0:1789635436.778754:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:3.0:1789635436.778765:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13856:x1876568410533248:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789635436.779193:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13856:x1876568410533248:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 428us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635436.779202:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:1.0:1789635436.781520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635436.781638:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410533376 00000100:00100000:2.0:1789635436.781647:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410533376 00000100:00100000:2.0:1789635436.781731:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:2.0:1789635436.781748:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13856:x1876568410533376:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789635436.782003:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13856:x1876568410533376:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 263us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635436.782011:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:1.0:1789635436.785080:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.785169:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410533504 00000100:00100000:3.0:1789635436.785191:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410533504 00000100:00100000:3.0:1789635436.785263:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:3.0:1789635436.785274:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13864:x1876568410533504:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635436.785545:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13864:x1876568410533504:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 271us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.785553:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:1.0:1789635436.790803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.790945:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410533632 00000100:00100000:3.0:1789635436.790956:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410533632 00000100:00100000:3.0:1789635436.791014:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:3.0:1789635436.791026:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13864:x1876568410533632:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789635436.791307:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13864:x1876568410533632:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 282us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.791358:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:1.0:1789635436.809548:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635436.809656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635436.809736:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635436.809901:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534144 00000100:00100000:0.0:1789635436.809913:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534144 00000100:00100000:0.0:1789635436.809971:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534016 00000100:00100000:0.0:1789635436.809975:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534016 00000100:00100000:0.0:1789635436.810000:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1789635436.810012:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410534144:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635436.810088:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410534144:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.810115:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1789635436.810135:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1789635436.810142:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410534016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635436.810170:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410534016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.810176:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1789635436.814469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635436.829292:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410533888 00000100:00100000:2.0:1789635436.829321:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410533888 00000100:00100000:2.0:1789635436.829447:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410533760 00000100:00100000:2.0:1789635436.829451:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410533760 00000100:00100000:2.0:1789635436.829475:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1789635436.829486:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2351:x1876568410533888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635436.829591:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2351:x1876568410533888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 106us (20052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635436.829628:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1789635436.829648:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789635436.829653:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1876568410533760:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789635436.829679:0:14484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f2c469f2-76dd-45bb-aea0-67c58be0b630@192.168.201.30@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:2.0:1789635436.829720:0:14484:0:(genops.c:1384:class_connect()) connect: client f2c469f2-76dd-45bb-aea0-67c58be0b630, cookie 0x77332204cfbb4107 00000004:00100000:2.0:1789635436.829772:0:14484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789635436.830200:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9e79f312c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789635436.830247:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2347:x1876568410533760:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 592us (15788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635436.830254:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1789635436.840451:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635436.840489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635436.840968:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534272 00000100:00100000:0.0:1789635436.840979:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534272 00000100:00100000:0.0:1789635436.841055:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534400 00000100:00100000:0.0:1789635436.841060:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534400 00000100:00100000:0.0:1789635436.841077:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789635436.841087:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+7:0:x1876568410534272:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789635436.841118:0:14486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1789635436.843837:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635436.844155:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+7:0:x1876568410534272:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 102us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.844177:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789635436.844742:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789635436.844771:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:13856:x1876568410534400:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789635436.844806:0:14486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789635436.845228:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:13856:x1876568410534400:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 467us (4728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.845237:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1789635436.849608:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.849773:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534528 00000100:00100000:3.0:1789635436.849786:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534528 00000100:00100000:3.0:1789635436.849865:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1789635436.849989:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:13856:x1876568410534528:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789635436.850113:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:13856:x1876568410534528:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 238us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.850121:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789635436.857800:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635436.858173:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534656 00000100:00100000:1.0:1789635436.858185:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534656 00000100:00100000:1.0:1789635436.858280:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1789635436.858290:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1876568410534656:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789635436.858549:0:15170:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f2c469f2-76dd-45bb-aea0-67c58be0b630@192.168.201.30@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:0.0:1789635436.858598:0:15170:0:(genops.c:1384:class_connect()) connect: client f2c469f2-76dd-45bb-aea0-67c58be0b630, cookie 0x77332204cfbb410e 00002000:00100000:0.0:1789635436.858622:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f2c469f2-76dd-45bb-aea0-67c58be0b630/ffff9e79ec736000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789635436.858636:0:15170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789635436.858645:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635436.858756:0:15593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534784 00000100:00100000:3.0:1789635436.858761:0:15593:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534784 00000100:00100000:3.0:1789635436.858791:0:15593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1789635436.858798:0:15593:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1876568410534784:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789635436.858814:0:15593:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f2c469f2-76dd-45bb-aea0-67c58be0b630@192.168.201.30@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:3.0:1789635436.858839:0:15593:0:(genops.c:1384:class_connect()) connect: client f2c469f2-76dd-45bb-aea0-67c58be0b630, cookie 0x77332204cfbb4115 00002000:00100000:3.0:1789635436.858844:0:15593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f2c469f2-76dd-45bb-aea0-67c58be0b630/ffff9e79d0486000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789635436.858851:0:15593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789635436.858946:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:3.0:1789635436.858950:0:15593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789635436.858977:0:15593:0:(import.c:65:import_set_state_nolock()) ffff9e79ec7a4800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789635436.858977:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9e79ec737800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789635436.859175:0:15593:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2347:x1876568410534784:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 374us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635436.859182:0:15593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789635436.859294:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2347:x1876568410534656:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 1004us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635436.859302:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789635436.860886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635436.860954:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410534912 00000100:00100000:1.0:1789635436.860961:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410534912 00000100:00100000:1.0:1789635436.860994:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1789635436.861000:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:13856:x1876568410534912:12345-192.168.201.30@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789635436.861076:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789635436.861133:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:13856:x1876568410534912:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 132us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635436.861141:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1789635437.001053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635437.001167:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535040 00000100:00100000:2.0:1789635437.001179:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535040 00000100:00100000:2.0:1789635437.001259:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1789635437.001270:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:13884:x1876568410535040:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:2.0:1789635437.001294:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635437.001673:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb411c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4d8 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635437.001733:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635437.001747:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635437.001817:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635437.001869:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789635437.001927:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635437.001946:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635437.001968:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821600/0x77332204cfbb411c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 8 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635437.001981:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 7 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635437.001988:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635437.001990:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635437.001992:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821800, rc 0) 00000100:00100000:2.0:1789635437.002045:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+7:13884:x1876568410535040:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 776us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635437.002051:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00010000:00010000:2.0:1789635437.587640:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635438.612100:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635438.870440:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422053504:0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.870517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635438.870568:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422054016:0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.870608:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635438.870633:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635438.870638:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422053888:0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.870658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635438.871736:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422053760:0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.871790:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635438.871807:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422054272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635438.872057:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635438.872082:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789635438.872089:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422053632:0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.872110:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635438.872129:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422054144:0@lo:400:kworker.0 00000100:00100000:3.0:1789635438.872430:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422053504 00000100:00100000:3.0:1789635438.872438:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422053504 00000100:00100000:3.0:1789635438.872489:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789635438.872501:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3307:x1876568422053504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635438.872563:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3307:x1876568422053504:12345-0@lo:400:kworker.0 Request processed in 63us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635438.872569:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789635438.872688:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635438.872717:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422054016 00000100:00100000:0.0:1789635438.872722:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422054016 00000100:00100000:0.0:1789635438.872754:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422053888 00000100:00100000:0.0:1789635438.872757:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422053888 00000100:00100000:3.0:1789635438.873177:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422054144 00000100:00100000:3.0:1789635438.873181:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422054144 00000100:00100000:3.0:1789635438.873202:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789635438.873209:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422054016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789635438.875181:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422054272 00000100:00100000:2.0:1789635438.875382:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422053760 00000100:00100000:2.0:1789635438.875392:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422053760 00000100:00100000:2.0:1789635438.875439:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422053632 00000100:00100000:2.0:1789635438.875443:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422053632 00000100:00100000:1.0:1789635438.875605:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422054272 00000100:00100000:1.0:1789635438.875640:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789635438.875649:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422054272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635438.875858:0:14484:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789635438.875868:0:14484:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789635438.875885:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635438.875923:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422053760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.876009:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876568422053760:12345-0@lo:400:kworker.0 Request processed in 88us (4218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635438.876016:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789635438.876032:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789635438.876054:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422053632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.876084:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422053632:12345-0@lo:400:kworker.0 Request processed in 47us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635438.876090:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00002000:00000024:1.0:1789635438.876130:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635438.876165:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876568422054272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 517us (4108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635438.876170:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789635438.876261:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789635438.876266:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789635438.876277:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789635438.882095:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422053632:0@lo:400:kworker.0 00000100:00100000:1.0:1789635438.882114:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789635438.882133:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422053760:0@lo:400:kworker.0 00000100:00100000:1.0:1789635438.882155:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876568422054272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635438.883299:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876568422054016:12345-0@lo:400:kworker.0 Request processed in 10086us (12686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635438.883333:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789635438.883359:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789635438.883369:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422054144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635438.883410:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876568422054144:12345-0@lo:400:kworker.0 Request processed in 44us (10721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635438.883424:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789635438.883659:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789635438.884274:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422053888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.884277:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422053504:0@lo:400:kworker.0 00000100:00100000:0.0:1789635438.884292:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876568422054016:0@lo:400:kworker.0 00000100:00100000:1.0:1789635438.884337:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876568422053888:12345-0@lo:400:kworker.0 Request processed in 67us (13677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635438.884342:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876568422053888:0@lo:400:kworker.0 00000100:00100000:1.0:1789635438.884344:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789635438.884906:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876568422054144:0@lo:400:kworker.0 00000001:00100000:0.0:1789635438.934165:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2c469f2-76dd-45bb-aea0-67c58be0b630 00000001:00100000:1.0:1789635438.939681:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c242a26-81b5-4d10-8aab-35c76a4f1728 00000001:00100000:1.0:1789635438.939868:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f2c469f2-76dd-45bb-aea0-67c58be0b630 00010000:00010000:2.0:1789635439.635606:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789635439.890749:0:16450:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789635440.403641:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dc2c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422054400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789635440.403714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635440.403949:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422054400 00000100:00100000:1.0:1789635440.403958:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422054400 00000100:00100000:1.0:1789635440.404029:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789635440.404039:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422054400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789635440.404076:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635440.404125:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422054400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635440.404132:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789635440.404220:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dc2c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422054400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789635440.404357:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789635440.660711:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789635441.516588:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2c469f2-76dd-45bb-aea0-67c58be0b630 00000040:00080000:2.0:1789635441.557223:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789635441.684504:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635442.287782:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635442.287833:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635442.287873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635442.287891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635442.287913:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635442.287931:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635442.287955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635442.287983:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535424 00000100:00100000:2.0:1789635442.287995:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535424 00000100:00100000:2.0:1789635442.288047:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535936 00000100:00100000:2.0:1789635442.288051:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535936 00000100:00100000:2.0:1789635442.288065:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535552 00000100:00100000:2.0:1789635442.288067:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535552 00000100:00100000:2.0:1789635442.288077:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535808 00000100:00100000:2.0:1789635442.288079:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535808 00000100:00100000:2.0:1789635442.288095:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789635442.288104:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410535424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635442.288179:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410535424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635442.288186:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789635442.288202:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789635442.288209:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410535936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635442.288231:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410535936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635442.288237:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789635442.288247:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789635442.288253:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410535552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635442.288272:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410535552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635442.288284:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789635442.288294:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1789635442.288300:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410535808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789635442.288474:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410535808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 173us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635442.288482:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00080000:2.0:1789635442.288501:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635442.288505:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635442.288886:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535168 00000100:00100000:0.0:1789635442.288892:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535168 00000100:00100000:0.0:1789635442.288929:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:0.0:1789635442.288937:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2350:x1876568410535168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635442.288980:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2350:x1876568410535168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635442.288987:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:0.0:1789635442.289025:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535680 00000100:00100000:0.0:1789635442.289029:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535680 00000100:00100000:0.0:1789635442.289065:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410535296 00000100:00100000:0.0:1789635442.289069:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410535296 00000100:00100000:0.0:1789635442.289088:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:0.0:1789635442.289094:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2350:x1876568410535680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635442.289124:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2350:x1876568410535680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635442.289130:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:0.0:1789635442.289141:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789635442.289147:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2350:x1876568410535296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635442.289169:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2350:x1876568410535296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635442.289175:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00080000:0.0:1789635442.289195:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789635442.708735:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635443.732103:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789635443.943423:0:16598:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe86965e00 20000000:00000080:2.0:1789635443.943445:0:16598:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e79f3060400 uarg=0000000000000000 20000000:01000000:2.0:1789635443.943501:0:16598:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635443.943508:0:16598:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789635443.943514:0:16598:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789635443.951806:0:16599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789635443.956463:0:16598:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789635443.971624:0:16598:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789635443.971870:0:16598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.971893:0:16598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 18 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.971901:0:16598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.971909:0:16598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.971918:0:16598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.971943:0:16598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.971951:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.972000:0:16598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.972016:0:16598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 12 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635443.972032:0:16598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054528:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635443.972178:0:16598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.972187:0:16598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 12 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635443.972195:0:16598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054656:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635443.972225:0:16598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.972232:0:16598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 18 pid: 14476 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635443.972240:0:16598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054784:0@lo:104: 00000100:00100000:2.0:1789635443.972274:0:16598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789635443.972379:0:16598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.972387:0:16598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 18 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635443.972395:0:16598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054912:0@lo:104: 00000100:00100000:2.0:1789635443.972417:0:16598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635443.972446:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422054784 00000100:00100000:2.0:1789635443.972453:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422054784 00000100:00100000:2.0:1789635443.972504:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422054912 00000100:00100000:2.0:1789635443.972507:0:14467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422054912 00000100:00100000:2.0:1789635443.972523:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635443.972532:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+4:16598:x1876568422054784:12345-0@lo:104: 00010000:00010000:2.0:1789635443.972545:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.972599:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789635443.972606:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+4:16598:x1876568422054784:12345-0@lo:104: Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635443.972613:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789635443.972630:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789635443.972636:0:14467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:16598:x1876568422054912:12345-0@lo:104: 00010000:00010000:2.0:1789635443.972644:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.972676:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789635443.972693:0:14467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:16598:x1876568422054912:12345-0@lo:104: Request processed in 46us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635443.973566:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789635443.973627:0:16598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 18 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.973637:0:16598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 18 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635443.973646:0:16598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422055040:0@lo:104: 00000100:00100000:2.0:1789635443.973685:0:16598:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635443.973709:0:16598:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79dbccea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635443.973742:0:16598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054784:0@lo:104: 00000100:00100000:2.0:1789635443.973753:0:16598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054912:0@lo:104: 00000100:00100000:0.0:1789635443.973768:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789635443.973781:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055040 00000100:00100000:0.0:1789635443.973785:0:14468:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055040 00000100:00100000:0.0:1789635443.973923:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789635443.973946:0:14468:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dbdbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:16598:x1876568422055040:12345-0@lo:104: 00010000:00010000:0.0:1789635443.973956:0:14468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.973979:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635443.973987:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.973995:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79c1676800 already unused, calling callback (ffffffffc1bf6c20) 00010000:00010000:0.0:1789635443.973996:0:14468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:3.0:1789635443.973999:0:14473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635443.974001:0:14468:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dbdbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8229a1b-c2b6-4ba8-903c-807c449e978b+3:16598:x1876568422055040:12345-0@lo:104: Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635443.974007:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789635443.974009:0:14473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635443.974016:0:14473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635443.974021:0:14473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635443.974049:0:14473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974216:0:14473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635443.974240:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974247:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79c1676800/0x77332204cfbb3fa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3fa9 expref: -99 pid: 15887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974270:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789635443.974273:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974278:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79e7c73800 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635443.974281:0:14473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974288:0:14473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635443.974294:0:14473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635443.974300:0:14473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635443.974330:0:14473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974336:0:14473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635443.974351:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974357:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79e7c73800/0x77332204cfbb3e67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e6e expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974366:0:14473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635443.974368:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974383:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84400 already unused, calling callback (ffffffffc1bf6c20) 10000000:00010000:3.0:1789635443.974386:0:14473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974392:0:14473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789635443.974398:0:14473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789635443.974403:0:14473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789635443.974414:0:14473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974419:0:14473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789635443.974425:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974431:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e79d3b84400/0x77332204cfbb3e1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x77332204cfbb3e21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.974444:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635443.974446:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635443.974447:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635443.974455:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635443.974473:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422055168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635443.974517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635443.974552:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422055296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635443.974599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635443.974617:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635443.974622:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422055424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789635443.974642:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635443.974666:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055168 00000100:00100000:3.0:1789635443.974670:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055168 00010000:00010000:3.0:1789635443.974691:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 19 pid: 14476 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635443.974707:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055296 00000100:00100000:3.0:1789635443.974710:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055296 00010000:00010000:3.0:1789635443.974723:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 20 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635443.975267:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055424 00000100:00100000:3.0:1789635443.975272:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055424 00010000:00010000:3.0:1789635443.975287:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 21 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635443.975300:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789635443.975307:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+21:3307:x1876568422055168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635443.975340:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635443.975346:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 21 pid: 14476 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975356:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 21 pid: 14476 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975370:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb3fa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb3fa2 expref: 21 pid: 14476 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975395:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635443.975407:0:16598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422055040:0@lo:104: 00000100:00100000:3.0:1789635443.975428:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+20:3307:x1876568422055168:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635443.975434:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789635443.975451:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635443.975457:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3308:x1876568422055296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635443.975464:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635443.975468:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 19 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975477:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 19 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975500:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe820a00/0x77332204cfbb3e6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb3e67 expref: 19 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975509:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635443.975545:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:3308:x1876568422055296:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635443.975551:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789635443.975563:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635443.975626:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc0be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:3308:x1876568422055424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789635443.975634:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635443.975638:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 17 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975646:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 17 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975661:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79e7c73600/0x77332204cfbb3e21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x77332204cfbb3e1a expref: 17 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.975669:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635443.975691:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc0be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:3308:x1876568422055424:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635443.975697:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789635443.975815:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8229a1b-c2b6-4ba8-903c-807c449e978b:3307:1876568422055168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635443.975830:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422055424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635443.975837:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422055296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789635443.979262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635443.979352:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635443.979405:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536064 00000100:00100000:2.0:1789635443.979416:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536064 00010000:00010000:2.0:1789635443.979452:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 13 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635443.979498:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536192 00000100:00100000:2.0:1789635443.979501:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536192 00010000:00010000:2.0:1789635443.979515:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 14 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635443.979553:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789635443.979562:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+14:2349:x1876568410536064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635443.979580:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635443.979586:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 14 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979598:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 14 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979620:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635443.979671:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+14:2349:x1876568410536064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635443.979679:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789635443.979715:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1789635443.979722:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2349:x1876568410536192:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635443.979731:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635443.979736:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 13 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979746:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 13 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979759:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979767:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979792:0:14470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979800:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979806:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979814:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979820:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635443.979829:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979838:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979848:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635443.979859:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635443.979880:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2349:x1876568410536192:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 158us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635443.979887:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:3.0:1789635443.980621:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7a02051e00/0x77332204cfbb4100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ae expref: 12 pid: 14479 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635443.980644:0:16598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054528:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635443.980658:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e78c2219c00/0x77332204cfbb40c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d44c expref: 11 pid: 14478 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635443.980668:0:16598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16598:1876568422054656:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635443.980717:0:16598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.980729:0:16598:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.980736:0:16598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635443.980744:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e79fe821e00/0x77332204cfbb412a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635443.988016:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789635443.988038:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422055552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789635443.988098:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635443.988168:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055552 00000100:00100000:1.0:1789635443.988176:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055552 00000100:00100000:1.0:1789635443.988230:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635443.988238:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422055552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789635443.988279:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789635443.988347:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876568422055552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635443.988354:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789635443.988396:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876568422055552:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789635443.988449:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789635443.991503:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422055808:0@lo:400:kworker.0 00000100:00100000:2.0:1789635443.991578:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635443.991614:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789635443.991631:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422055936:0@lo:400:kworker.0 00000100:00100000:2.0:1789635443.991656:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635443.991778:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422056064:0@lo:400:kworker.0 00000100:00100000:0.0:1789635443.991806:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635443.991826:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635443.991831:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422055680:0@lo:400:kworker.0 00000100:00100000:0.0:1789635443.991856:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635443.991885:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055808 00000100:00100000:0.0:1789635443.991894:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055808 00000100:00100000:0.0:1789635443.991940:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055936 00000100:00100000:0.0:1789635443.991943:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055936 00000100:00100000:0.0:1789635443.991962:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056064 00000100:00100000:0.0:1789635443.991965:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056064 00000100:00100000:0.0:1789635443.991982:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635443.991989:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422055808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635443.992041:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876568422055808:12345-0@lo:400:kworker.0 Request processed in 51us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635443.992049:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789635443.992076:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635443.992082:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422055936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635443.992112:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422055936:12345-0@lo:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635443.992118:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789635443.992129:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635443.992135:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422056064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635443.992165:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422056064:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635443.992172:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789635443.992186:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635443.992212:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422056064:0@lo:400:kworker.0 00000100:00100000:2.0:1789635443.992292:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422055936:0@lo:400:kworker.0 00000100:00100000:2.0:1789635443.992302:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876568422055808:0@lo:400:kworker.0 00000100:00100000:0.0:1789635443.993642:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422055680 00000100:00100000:0.0:1789635443.993654:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422055680 00000100:00100000:0.0:1789635443.993737:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635443.993746:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422055680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635443.993822:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422055680:12345-0@lo:400:kworker.0 Request processed in 76us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635443.993829:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635443.993877:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422055680:0@lo:400:kworker.0 00000100:00080000:3.0:1789635443.996806:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789635444.757972:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789635445.438413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635445.438570:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536320 00000100:00100000:2.0:1789635445.438587:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536320 00000100:00100000:2.0:1789635445.438663:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:2.0:1789635445.438677:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+11:13741:x1876568410536320:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635445.438700:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635445.438729:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820600/0x77332204cfbb4131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4df expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.438769:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820600/0x77332204cfbb4131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4df expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.438782:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820600/0x77332204cfbb4131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4df expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.438793:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820600, rc 0) 00000100:00100000:2.0:1789635445.438887:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13741:x1876568410536320:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 212us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635445.438894:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:2.0:1789635445.442534:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635445.443117:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536448 00000100:00100000:3.0:1789635445.443133:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536448 00000100:00100000:3.0:1789635445.443668:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:3.0:1789635445.443684:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13741:x1876568410536448:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635445.447468:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13741:x1876568410536448:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 3761us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.447484:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:3.0:1789635445.451249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635445.459563:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536576 00000100:00100000:0.0:1789635445.459591:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536576 00000100:00100000:0.0:1789635445.459852:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:0.0:1789635445.459869:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13741:x1876568410536576:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.460223:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13741:x1876568410536576:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 357us (9055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635445.460233:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:0.0:1789635445.474853:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635445.485215:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536704 00000100:00100000:2.0:1789635445.485238:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536704 00000100:00100000:2.0:1789635445.485323:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:2.0:1789635445.485334:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+12:13741:x1876568410536704:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635445.485372:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635445.485397:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79fe820000/0x77332204cfbb4138 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4e6 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.485433:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79fe820000/0x77332204cfbb4138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4e6 expref: 13 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.485446:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79fe820000/0x77332204cfbb4138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4e6 expref: 13 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.485454:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820000, rc 0) 00000100:00100000:2.0:1789635445.485553:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13741:x1876568410536704:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 221us (10719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635445.485559:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:3.0:1789635445.488539:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635445.488674:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536832 00000100:00100000:1.0:1789635445.488687:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536832 00000100:00100000:1.0:1789635445.488822:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:1.0:1789635445.488837:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13741:x1876568410536832:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635445.490730:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13741:x1876568410536832:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 1885us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635445.490745:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1789635445.505230:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635445.505343:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410536960 00000100:00100000:3.0:1789635445.505360:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410536960 00000100:00100000:3.0:1789635445.505433:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1789635445.505446:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13741:x1876568410536960:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635445.506157:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:13741:x1876568410536960:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 709us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.506170:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1789635445.528427:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789635445.528468:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422056192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789635445.528566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635445.528665:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056192 00000100:00100000:3.0:1789635445.528676:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056192 00000100:00100000:3.0:1789635445.528753:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789635445.528765:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422056192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635445.528818:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635445.528888:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422056192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.528895:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789635445.528919:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789635445.528966:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422056192:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1789635445.718608:0:14481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635445.718617:0:14481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79fe701000 from 10 10000000:01000000:0.0:1789635445.718623:0:14481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635445.718943:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79f303d400/0x77332204cfbb413f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.718955:0:14481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79f303d400/0x77332204cfbb413f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.718968:0:14481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79f303d400/0x77332204cfbb413f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635445.718998:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.719072:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635445.719131:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635445.719184:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056320 00000100:00100000:1.0:1789635445.719196:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056320 00000100:00100000:0.0:1789635445.719463:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789635445.719477:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+16:14481:x1876568422056320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635445.719495:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635445.719513:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79f303da00/0x77332204cfbb4146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb413f expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.719546:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79f303da00/0x77332204cfbb4146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb413f expref: 17 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.719560:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79f303da00/0x77332204cfbb4146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb413f expref: 17 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.719585:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303da00, rc 0) 00000100:00100000:0.0:1789635445.720968:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:14481:x1876568422056320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1479us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635445.720984:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789635445.724745:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789635445.724791:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79f303d400/0x77332204cfbb413f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4146 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635445.724810:0:14481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79f303d400/0x77332204cfbb413f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb4146 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635445.724942:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635445.725039:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635445.725234:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c2b31f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789635445.725590:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056448 00000100:00100000:3.0:1789635445.725603:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056448 00000100:00100000:2.0:1789635445.725927:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789635445.725944:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:14481:x1876568422056448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789635445.726937:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:14481:x1876568422056448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 993us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635445.726950:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789635445.727161:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789635445.727215:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635445.727428:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635445.727529:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c70f8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635445.727638:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056576 00000100:00100000:2.0:1789635445.727646:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056576 00000100:00100000:2.0:1789635445.727698:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789635445.727709:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:14481:x1876568422056576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789635445.727939:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:14481:x1876568422056576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635445.727945:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789635445.728163:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b67480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789635445.734308:0:16669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789635445.735419:0:14481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789635445.735475:0:14481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635445.735490:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79f303d400/0x77332204cfbb413f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4146 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.735505:0:14481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79f303d400/0x77332204cfbb413f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4146 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635445.735518:0:14481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635445.735522:0:14481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79c8381000 from 10 10000000:01000000:0.0:1789635445.735526:0:14481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635445.735571:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79f303d200/0x77332204cfbb414d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.735581:0:14481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79f303d200/0x77332204cfbb414d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.735594:0:14481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79f303d200/0x77332204cfbb414d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635445.735622:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.735698:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635445.735757:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635445.735772:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056704 00000100:00100000:1.0:1789635445.735787:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056704 00000100:00100000:1.0:1789635445.735862:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789635445.735874:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+17:14481:x1876568422056704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789635445.735894:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635445.735914:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb4154 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb414d expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635445.735946:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb4154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb414d expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635445.735958:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e79d3b85000/0x77332204cfbb4154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb414d expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635445.735987:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b85000, rc 0) 00000100:00100000:1.0:1789635445.736204:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:14481:x1876568422056704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 331us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635445.736211:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789635445.736785:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635445.736813:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79f303d200/0x77332204cfbb414d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4154 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.736826:0:14481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79f303d200/0x77332204cfbb414d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb4154 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635445.736910:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.736945:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635445.737025:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635445.737059:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056832 00000100:00100000:1.0:1789635445.737064:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056832 00000100:00100000:1.0:1789635445.737177:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789635445.737186:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:14481:x1876568422056832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635445.737532:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:14481:x1876568422056832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635445.737541:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789635445.737635:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.737679:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.737732:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635445.738196:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635445.738238:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422056960 00000100:00100000:3.0:1789635445.738244:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422056960 00000100:00100000:3.0:1789635445.738542:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789635445.738550:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:14481:x1876568422056960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789635445.738930:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:14481:x1876568422056960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 380us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.738938:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789635445.739059:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422056960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789635445.743384:0:16670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789635445.743658:0:14481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789635445.743694:0:14481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635445.743710:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79f303d200/0x77332204cfbb414d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4154 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.743726:0:14481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79f303d200/0x77332204cfbb414d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4154 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789635445.743740:0:14481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789635445.743743:0:14481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e79e734d800 from 10 10000000:01000000:0.0:1789635445.743747:0:14481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789635445.743797:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79f303c200/0x77332204cfbb415b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.743829:0:14481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e79f303c200/0x77332204cfbb415b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.743844:0:14481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e79f303c200/0x77332204cfbb415b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635445.743874:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422057088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.743969:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635445.744023:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789635445.744214:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422057088 00000100:00100000:3.0:1789635445.744225:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422057088 00000100:00100000:3.0:1789635445.744289:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789635445.744301:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+18:14481:x1876568422057088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789635445.744354:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635445.744381:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e78c2218c00/0x77332204cfbb4162 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x77332204cfbb415b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635445.744417:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e78c2218c00/0x77332204cfbb4162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x77332204cfbb415b expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635445.744429:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e78c2218c00/0x77332204cfbb4162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x77332204cfbb415b expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635445.744439:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2218c00, rc 0) 00000100:00100000:3.0:1789635445.744504:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422057088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635445.744513:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789635445.744539:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422057088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789635445.744556:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e79f303c200/0x77332204cfbb415b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4162 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.744566:0:14481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e79f303c200/0x77332204cfbb415b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x77332204cfbb4162 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635445.744731:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422057216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.744765:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635445.744787:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635445.744795:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422057216 00000100:00100000:1.0:1789635445.744800:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422057216 00000100:00100000:1.0:1789635445.744836:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789635445.744845:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422057216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789635445.745410:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422057216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 565us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635445.745420:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789635445.747681:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422057216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.747767:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422057344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789635445.747859:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635445.747904:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422057344 00000100:00100000:0.0:1789635445.747906:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d04929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789635445.747915:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422057344 00000100:00100000:1.0:1789635445.748012:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789635445.748032:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422057344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789635445.748302:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:14481:x1876568422057344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635445.748383:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789635445.748485:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8229a1b-c2b6-4ba8-903c-807c449e978b:14481:1876568422057344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789635445.750171:0:16671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789635445.751197:0:14481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789635445.751247:0:14481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789635445.751260:0:14481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e79f303c200/0x77332204cfbb415b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4162 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635445.751283:0:14481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e79f303c200/0x77332204cfbb415b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x77332204cfbb4162 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635445.779639:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789635446.805924:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789635447.410075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635447.410125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635447.410165:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635447.410197:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635447.410230:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635447.410253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635447.410922:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635447.410975:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537344 00000100:00100000:2.0:1789635447.410990:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537344 00000100:00100000:2.0:1789635447.412130:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537856 00000100:00100000:2.0:1789635447.412144:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537856 00000100:00100000:2.0:1789635447.412166:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537472 00000100:00100000:2.0:1789635447.412169:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537472 00000100:00100000:2.0:1789635447.412184:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537728 00000100:00100000:2.0:1789635447.412187:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537728 00000100:00100000:2.0:1789635447.412209:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1789635447.412223:0:15167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410537344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635447.412443:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537600 00000100:00100000:0.0:1789635447.412449:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537600 00000100:00100000:0.0:1789635447.412493:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537216 00000100:00100000:0.0:1789635447.412496:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537216 00000100:00100000:0.0:1789635447.412518:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:0.0:1789635447.412526:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2351:x1876568410537600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635447.412633:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2351:x1876568410537600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 107us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.412642:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:0.0:1789635447.412664:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:0.0:1789635447.412671:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2351:x1876568410537216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635447.412697:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2351:x1876568410537216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (2466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.412703:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:0.0:1789635447.412898:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789635447.412907:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2351:x1876568410537856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635447.412937:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2351:x1876568410537856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.412943:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789635447.412967:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789635447.412973:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410537472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635447.412996:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410537472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.413002:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789635447.413011:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789635447.413017:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2351:x1876568410537728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635447.413037:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2351:x1876568410537728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635447.413042:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00080000:0.0:1789635447.413106:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789635447.413112:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789635447.413114:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635447.414096:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537088 00000100:00100000:1.0:1789635447.414109:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537088 00000100:00100000:1.0:1789635447.414171:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:1.0:1789635447.414181:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2351:x1876568410537088:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635447.414250:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2351:x1876568410537088:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635447.414258:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:2.0:1789635447.414834:0:15167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2351:x1876568410537344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2612us (4706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635447.414846:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00010000:00010000:3.0:1789635447.830630:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635448.653395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635448.653627:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410537984 00000100:00100000:1.0:1789635448.653639:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410537984 00000100:00100000:1.0:1789635448.653712:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1789635448.653723:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:14397:x1876568410537984:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789635448.653747:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789635448.653773:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb4169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4ed expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.653845:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.653862:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.653880:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.653898:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.653922:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.653931:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654301:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb417e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654355:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb417e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654362:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb417e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789635448.654388:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789635448.654391:0:14486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789635448.654442:0:14486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb417e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654453:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654460:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654468:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654474:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635448.654479:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654492:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654506:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:1.0:1789635448.654509:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635448.654768:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654777:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85600/0x77332204cfbb4170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654793:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654799:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654806:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654811:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b84c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635448.654815:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654822:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654830:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e79d898a400) 00010000:00010000:1.0:1789635448.654833:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789635448.654836:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654852:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84c00/0x77332204cfbb4177 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654904:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85200/0x77332204cfbb4169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ed expref: 8 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654922:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b84400/0x77332204cfbb417e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4ed expref: 7 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.654929:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e79d898a800) 00010000:00010000:1.0:1789635448.654932:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789635448.654934:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79d3b84400, rc 0) 00000100:00100000:1.0:1789635448.660195:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:14397:x1876568410537984:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 6458us (6794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635448.661618:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1789635448.665209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635448.665292:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410538240 00000100:00100000:0.0:1789635448.665353:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410538240 00000100:00100000:0.0:1789635448.665802:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789635448.665819:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:14397:x1876568410538240:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635448.665853:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635448.665889:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4185 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4f4 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.665994:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666014:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666064:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666086:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666093:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666099:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666634:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303de00/0x77332204cfbb419a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666645:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303de00/0x77332204cfbb419a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.666654:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303de00/0x77332204cfbb419a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635448.666667:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789635448.671109:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671132:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671141:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671148:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303c800 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635448.671166:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671175:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671195:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e79d898a800) 00010000:00010000:0.0:1789635448.671199:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635448.671205:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671211:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb418c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671229:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671237:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671243:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671248:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303c000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635448.671252:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671259:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671266:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e79d088ea00) 00010000:00010000:0.0:1789635448.671269:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635448.671279:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.671286:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4193 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.675793:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4185 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4f4 expref: 10 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.675835:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303de00/0x77332204cfbb419a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4f4 expref: 9 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.675846:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:0.0:1789635448.675850:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635448.675855:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303de00, rc 0) 00000100:00100000:0.0:1789635448.675964:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14397:x1876568410538240:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 10147us (10763us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789635448.675975:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1789635448.688572:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635448.689243:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410538368 00000100:00100000:0.0:1789635448.689256:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410538368 00000100:00100000:0.0:1789635448.689367:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789635448.689379:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14397:x1876568410538368:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789635448.689512:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14397:x1876568410538368:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 135us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635448.689520:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000040:00080000:2.0:1789635448.725004:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789635448.780224:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635448.780364:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410538496 00000100:00100000:2.0:1789635448.780376:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410538496 00000100:00100000:2.0:1789635448.780451:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1789635448.780462:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14403:x1876568410538496:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635448.780484:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635448.780508:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d4fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780580:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780595:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780607:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780633:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780641:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780655:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780878:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780886:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780891:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780897:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635448.780902:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780909:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780922:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635448.780925:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635448.780929:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780935:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780948:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780953:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780959:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780972:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635448.780975:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780980:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.780989:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e79d91f3600) 00010000:00010000:2.0:1789635448.780992:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635448.780995:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.781001:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb41b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.781033:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4fb expref: 10 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.781043:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635448.781046:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635448.781050:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4fb expref: 10 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.781059:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821e00, rc 0) 00000100:00100000:2.0:1789635448.781130:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14403:x1876568410538496:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 670us (925us total) trans 0 rc 301/301 00000100:00100000:2.0:1789635448.781137:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1789635448.787498:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635448.789878:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410538624 00000100:00100000:0.0:1789635448.789905:0:14493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410538624 00000100:00100000:0.0:1789635448.790122:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789635448.790146:0:14493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14403:x1876568410538624:12345-192.168.201.30@tcp:700:lfs.0 00000100:00100000:0.0:1789635448.790407:0:14493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14403:x1876568410538624:12345-192.168.201.30@tcp:700:lfs.0 Request processed in 254us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635448.790416:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1789635448.799680:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635448.799841:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410538880 00000100:00100000:2.0:1789635448.799852:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410538880 00000100:00100000:2.0:1789635448.799909:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1789635448.799921:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14403:x1876568410538880:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1789635448.799984:0:16411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635448.800013:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb40eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d476 expref: 9 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.800032:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635448.800038:0:16411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635448.800291:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.800306:0:16411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 5 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.800361:0:16411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.800406:0:16411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 5 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.800423:0:16411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 5 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635448.800437:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16411:1876568422057472:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789635448.800533:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789635448.802536:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7a0e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16411:1876568422057472:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789635448.802583:0:16411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635448.803106:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635448.803450:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410539008 00000100:00100000:2.0:1789635448.803460:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410539008 00010000:00010000:2.0:1789635448.803509:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 6 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635448.803555:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789635448.803565:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dc2cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2348:x1876568410539008:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635448.803582:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635448.803589:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 6 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.803603:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 6 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.803628:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb4123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d4d8 expref: 6 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.803646:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635448.803732:0:14470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.803743:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.803752:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.803879:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635448.803945:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2348:x1876568410539008:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 381us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635448.803953:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00010000:00010000:0.0:1789635448.805115:0:16411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.805130:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.805158:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.805170:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.805180:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635448.807494:0:16411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789635448.807515:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.807526:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.807535:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.807542:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635448.807547:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.807556:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.807573:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635448.807576:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635448.807580:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.807587:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789635448.807607:0:16411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbd9f741 reply state 00000000f75a0ac1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635448.807623:0:16411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635448.807738:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dc2c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+10:14403:x1876568410538880:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 7816us (8064us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789635448.807747:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00010000:00010000:2.0:1789635448.811688:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.811707:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.811716:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.811723:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303dc00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635448.811728:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.811738:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.811757:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e79d088ea00) 00010000:00010000:2.0:1789635448.811761:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635448.811766:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.811772:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb41c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635448.851728:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635448.914880:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635448.915078:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410539136 00000100:00100000:2.0:1789635448.915090:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410539136 00000100:00100000:2.0:1789635448.915173:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1789635448.915185:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:14411:x1876568410539136:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:2.0:1789635448.915220:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635448.915245:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d502 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.915347:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb41d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.915363:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb41d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.915376:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb41d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635448.915424:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789635448.915429:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635448.915472:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb41d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.915499:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d502 expref: 11 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.915519:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821800/0x77332204cfbb41d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d502 expref: 10 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.915529:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635448.915532:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635448.915536:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821800, rc 0) 00000100:00100000:2.0:1789635448.915605:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+10:14411:x1876568410539136:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 422us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635448.915619:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789635448.944526:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635448.944719:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410539264 00000100:00100000:0.0:1789635448.944732:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410539264 00000100:00100000:0.0:1789635448.944798:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789635448.944809:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:14412:x1876568410539264:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635448.944831:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635448.944852:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb41d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d509 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.944914:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb41e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.944946:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.944958:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635448.944992:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789635448.944995:0:14486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789635448.945016:0:14486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.945038:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb41d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d509 expref: 7 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.945055:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c800/0x77332204cfbb41e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d509 expref: 6 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.945064:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:0.0:1789635448.945067:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789635448.945071:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303c800, rc 0) 00000100:00100000:0.0:1789635448.945127:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:14412:x1876568410539264:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 320us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635448.945133:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1789635448.959254:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635448.959551:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410539392 00000100:00100000:2.0:1789635448.959566:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410539392 00000100:00100000:2.0:1789635448.959645:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:2.0:1789635448.959656:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:14412:x1876568410539392:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635448.959678:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635448.959699:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d510 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959764:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959779:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959792:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959808:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959815:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959821:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959934:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb41fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959963:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb41fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.959971:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb41fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635448.960013:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789635448.960018:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789635448.960040:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb41fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960054:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960060:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960067:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960074:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635448.960079:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960086:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960100:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635448.960103:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635448.960108:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960125:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb41ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960142:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960148:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960154:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960160:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635448.960163:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960170:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960179:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e79d91f3600) 00010000:00010000:2.0:1789635448.960182:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789635448.960185:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960191:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820a00/0x77332204cfbb41f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960669:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821e00/0x77332204cfbb41e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d510 expref: 8 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960701:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb41fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d510 expref: 7 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635448.960710:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d91f3100) 00010000:00010000:2.0:1789635448.960712:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789635448.960715:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820200, rc 0) 00000100:00100000:2.0:1789635448.960801:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+7:14412:x1876568410539392:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1145us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635448.960810:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1789635448.963980:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635448.964053:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410539648 00000100:00100000:0.0:1789635448.964064:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410539648 00000100:00100000:0.0:1789635448.964123:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1789635448.964134:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+7:14412:x1876568410539648:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789635448.964156:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635448.964189:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d517 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635448.964298:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789635448.964455:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4203 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d517 expref: 9 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.964469:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:0.0:1789635448.964472:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635448.964477:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d517 expref: 9 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.964493:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303c000, rc 0) 00000100:00100000:0.0:1789635448.967540:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2c469f2-76dd-45bb-aea0-67c58be0b630+8:14412:x1876568410539648:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3395us (3556us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789635448.967554:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1789635448.971198:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635448.971874:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410539904 00000100:00100000:0.0:1789635448.971889:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410539904 00000100:00100000:0.0:1789635448.972100:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1789635448.972112:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+8:14412:x1876568410539904:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:0.0:1789635448.972172:0:14485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635448.972213:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820200/0x77332204cfbb41fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d510 expref: 8 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.972244:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d91f3100) 00010000:00010000:0.0:1789635448.972257:0:14485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635448.972285:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.972342:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635448.972354:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789635448.972596:0:14485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098b595e0 reply state 000000007a3e1bca transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635448.972606:0:14485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789635448.972628:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789635448.972725:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+9:14412:x1876568410539904:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 615us (1541us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789635448.972733:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00010000:00010000:3.0:1789635448.975580:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.975600:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635448.975604:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1789635448.975608:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.975625:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303d600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635448.975644:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.975654:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.975677:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d088ed00) 00010000:00010000:3.0:1789635448.975681:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789635448.975687:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.975693:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb4211 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635448.975743:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410540160 00000100:00100000:3.0:1789635448.975757:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410540160 00000100:00100000:3.0:1789635448.976125:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1789635448.976139:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+8:14412:x1876568410540160:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789635448.976459:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+9:14412:x1876568410540160:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 323us (857us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789635448.976468:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1789635448.982655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635448.982831:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410540416 00000100:00100000:3.0:1789635448.982843:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410540416 00000100:00100000:3.0:1789635448.982909:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1789635448.982921:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2c469f2-76dd-45bb-aea0-67c58be0b630+9:14412:x1876568410540416:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635448.982948:0:16411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635448.982972:0:16411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d51e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983075:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983091:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983102:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983114:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983120:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983126:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635448.983250:0:16411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789635448.983377:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983385:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983391:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983431:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635448.983436:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983454:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983468:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:3.0:1789635448.983471:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635448.983477:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983483:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb421f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983498:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983504:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983511:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983516:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635448.983519:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983526:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983533:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e79d3900200) 00010000:00010000:3.0:1789635448.983536:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635448.983538:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983554:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4226 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983592:0:16411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4218 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d51e expref: 11 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983603:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:3.0:1789635448.983605:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789635448.983621:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d51e expref: 11 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.983632:0:16411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2218400, rc 0) 00000100:00100000:3.0:1789635448.983694:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2c469f2-76dd-45bb-aea0-67c58be0b630+10:14412:x1876568410540416:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 776us (1052us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789635448.983702:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1789635448.986831:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635448.986948:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410540544 00000100:00100000:3.0:1789635448.986960:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410540544 00000100:00100000:3.0:1789635448.987023:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1789635448.987034:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+10:14412:x1876568410540544:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635448.987059:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635448.987082:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4234 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d525 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.987174:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.987188:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.987230:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635448.987257:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635448.987260:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635448.987277:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.987302:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4234 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 12 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.987344:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 11 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635448.987353:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d3900e00) 00010000:00010000:3.0:1789635448.987356:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789635448.987359:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2219200, rc 0) 00000100:00100000:3.0:1789635448.987420:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+11:14412:x1876568410540544:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 388us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635448.987427:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1789635448.990649:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635448.990854:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410540672 00000100:00100000:2.0:1789635448.990869:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410540672 00000100:00100000:2.0:1789635448.990931:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1789635448.990942:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+11:14412:x1876568410540672:12345-192.168.201.30@tcp:37:lfs.0 00000100:00100000:3.0:1789635448.994934:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+11:14412:x1876568410540672:12345-192.168.201.30@tcp:37:lfs.0 Request processed in 3983us (4285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635448.994950:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1789635448.999098:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635448.999172:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410540928 00000100:00100000:3.0:1789635448.999185:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410540928 00000100:00100000:3.0:1789635448.999257:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:3.0:1789635448.999270:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c2bdb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+11:14412:x1876568410540928:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789635448.999719:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c2bdb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+12:14412:x1876568410540928:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 451us (631us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789635448.999729:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789635449.044688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.044828:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410541056 00000100:00100000:3.0:1789635449.044842:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410541056 00000100:00100000:3.0:1789635449.044929:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:3.0:1789635449.044941:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+10:14418:x1876568410541056:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635449.044963:0:16411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635449.044983:0:16411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4242 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d52c expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045047:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045061:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045073:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045086:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045093:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045100:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045186:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb4257 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045226:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb4257 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045234:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb4257 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635449.045262:0:16411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789635449.045265:0:16411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635449.045306:0:16411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb4257 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045363:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045370:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045377:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045383:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635449.045388:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045407:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045420:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:3.0:1789635449.045423:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635449.045427:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045444:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045459:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045465:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045471:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045475:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635449.045478:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045484:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045491:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e79d3900200) 00010000:00010000:3.0:1789635449.045494:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635449.045496:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045502:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4250 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045532:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d52c expref: 12 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045558:0:16411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219c00/0x77332204cfbb4257 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d52c expref: 11 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.045566:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d3900e00) 00010000:00010000:3.0:1789635449.045569:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789635449.045571:0:16411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2219c00, rc 0) 00000100:00100000:3.0:1789635449.045643:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+11:14418:x1876568410541056:12345-192.168.201.30@tcp:101:bash.0 Request processed in 704us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635449.045652:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00080000:0.0:1789635449.046378:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635449.049557:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.049739:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410541312 00000100:00100000:3.0:1789635449.049754:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410541312 00000100:00100000:3.0:1789635449.049823:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1789635449.049834:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+11:14418:x1876568410541312:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635449.049858:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635449.049893:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb425e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d533 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.050022:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.050036:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 11 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.050044:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.050083:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 11 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.050110:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 11 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635449.050125:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14484:1876568422057600:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789635449.051003:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79cdd3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789635449.055614:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635449.055759:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410541440 00000100:00100000:2.0:1789635449.055770:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410541440 00010000:00010000:2.0:1789635449.055825:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 12 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635449.055867:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789635449.055877:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+12:2349:x1876568410541440:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635449.055920:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635449.055928:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 12 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.055943:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 12 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.055966:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d3900e00) 00010000:00010000:2.0:1789635449.055972:0:14469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.055982:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.055990:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.056010:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635449.056057:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2c469f2-76dd-45bb-aea0-67c58be0b630+12:2349:x1876568410541440:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 181us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635449.056064:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00080000:0.0:1789635449.056574:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789635449.057686:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb423b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d525 expref: 11 pid: 14484 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635449.057713:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14484:1876568422057600:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635449.057738:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.057749:0:14484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.057755:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.057784:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.057797:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.057807:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058848:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058869:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058890:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635449.058904:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789635449.058932:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058939:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058947:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058952:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635449.058957:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058964:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058976:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d3900e00) 00010000:00010000:3.0:1789635449.058979:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635449.058984:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.058990:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4265 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635449.059002:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005108937e reply state 000000003ae91ae0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635449.059018:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789635449.059056:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb425e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 14 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.059070:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 13 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.059077:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635449.059079:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789635449.059082:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2219400, rc 0) 00000100:00100000:3.0:1789635449.059156:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14418:x1876568410541312:12345-192.168.201.30@tcp:101:bash.0 Request processed in 9322us (9609us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789635449.059165:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00010000:00010000:3.0:1789635449.061239:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.061255:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.061263:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.061269:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635449.061275:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.061283:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.061337:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e79d3900200) 00010000:00010000:3.0:1789635449.061341:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635449.061345:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.061352:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb426c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635449.072924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.073660:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410541568 00000100:00100000:3.0:1789635449.073678:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410541568 00000100:00100000:3.0:1789635449.073746:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789635449.073759:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+13:14418:x1876568410541568:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789635449.073787:0:16411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635449.073811:0:16411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4281 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d53a expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.074007:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.074023:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.074035:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635449.074076:0:16411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789635449.074080:0:16411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635449.074101:0:16411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.074130:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.074158:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4281 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 15 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.074179:0:16411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 14 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.074188:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635449.074191:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635449.074195:0:16411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2218200, rc 0) 00000100:00100000:3.0:1789635449.074712:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14418:x1876568410541568:12345-192.168.201.30@tcp:101:bash.0 Request processed in 953us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635449.074721:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:2.0:1789635449.078761:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.078845:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410541824 00000100:00100000:3.0:1789635449.078857:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410541824 00000100:00100000:3.0:1789635449.078978:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1789635449.078989:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14418:x1876568410541824:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1789635449.079433:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:14418:x1876568410541824:12345-192.168.201.30@tcp:35:bash.0 Request processed in 444us (682us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789635449.079442:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1789635449.107703:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422057984:0@lo:400:kworker.0 00000100:00100000:0.0:1789635449.107795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635449.107847:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635449.107853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422058112:0@lo:400:kworker.0 00000100:00100000:0.0:1789635449.107882:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635449.107919:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422057984 00000100:00100000:0.0:1789635449.107929:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422057984 00000100:00100000:0.0:1789635449.107990:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789635449.107999:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e78c1381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422057984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635449.108050:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e78c1381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422057984:12345-0@lo:400:kworker.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635449.108057:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789635449.108096:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789635449.108123:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422057984:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108204:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422057728:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108240:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635449.108276:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422058240:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108300:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635449.108340:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789635449.108353:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422057856:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635449.108403:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422058368:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108423:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635449.108444:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422057856 00000100:00100000:2.0:1789635449.108449:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422057856 00000100:00100000:2.0:1789635449.108481:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789635449.108488:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422057856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108522:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422057856:12345-0@lo:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635449.108528:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789635449.108544:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789635449.108559:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422057856:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108575:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422058112 00000100:00100000:2.0:1789635449.108578:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422058112 00000100:00100000:2.0:1789635449.108596:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422058240 00000100:00100000:2.0:1789635449.108598:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422058240 00000100:00100000:2.0:1789635449.108613:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422058368 00000100:00100000:2.0:1789635449.108615:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422058368 00000100:00100000:2.0:1789635449.108627:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635449.108633:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422058112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108665:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876568422058112:12345-0@lo:400:kworker.0 Request processed in 32us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635449.108671:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789635449.108681:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635449.108687:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422058240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108713:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876568422058240:12345-0@lo:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635449.108726:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789635449.108738:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789635449.108743:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568422058368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108772:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876568422058368:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635449.108778:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789635449.108791:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789635449.108807:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876568422058112:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108824:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876568422058368:0@lo:400:kworker.0 00000100:00100000:2.0:1789635449.108833:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876568422058240:0@lo:400:kworker.0 00000100:00100000:1.0:1789635449.111488:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422058496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789635449.111554:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635449.111842:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422057728 00000100:00100000:0.0:1789635449.111852:0:14476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422057728 00000100:00100000:0.0:1789635449.111905:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789635449.111915:0:14476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3308:x1876568422057728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635449.111975:0:14476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3308:x1876568422057728:12345-0@lo:400:kworker.0 Request processed in 61us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635449.111981:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789635449.112033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8229a1b-c2b6-4ba8-903c-807c449e978b:3308:1876568422057728:0@lo:400:kworker.0 00000100:00100000:3.0:1789635449.112910:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422058496 00000100:00100000:3.0:1789635449.112919:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422058496 00000100:00100000:3.0:1789635449.112970:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789635449.112980:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422058496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635449.113030:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635449.113102:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422058496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635449.113109:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789635449.113832:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422058496:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789635449.178338:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1789635449.178358:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:1.0:1789635449.178380:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:1.0:1789635449.178386:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:1.0:1789635449.178410:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789635449.189282:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635449.189362:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410542080 00000100:00100000:2.0:1789635449.189373:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410542080 00000100:00100000:2.0:1789635449.189506:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:2.0:1789635449.189520:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+11:14428:x1876568410542080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789635449.189553:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635449.189580:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb428f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d541 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635449.189695:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789635449.189867:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb428f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d541 expref: 13 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.189880:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e79d91f3d00) 00010000:00010000:2.0:1789635449.189883:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635449.189902:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb428f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d541 expref: 13 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.189917:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821200, rc 0) 00000100:00100000:2.0:1789635449.190002:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+12:14428:x1876568410542080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 485us (728us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789635449.190009:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:2.0:1789635449.192790:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.194590:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410542336 00000100:00100000:0.0:1789635449.194605:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410542336 00000100:00100000:1.0:1789635449.194821:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1789635449.194835:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+12:14428:x1876568410542336:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789635449.195111:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+13:14428:x1876568410542336:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 278us (2328us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789635449.195119:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1789635449.254652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.254738:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410542592 00000100:00100000:3.0:1789635449.254750:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410542592 00000100:00100000:3.0:1789635449.254875:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1789635449.254887:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+13:14431:x1876568410542592:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789635449.254912:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635449.254931:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb429d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d548 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.255043:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.255069:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.255082:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635449.255094:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789635449.255863:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb429d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d548 expref: 16 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.255885:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d548 expref: 15 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.255893:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635449.255912:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635449.255916:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2218e00, rc 0) 00000100:00100000:3.0:1789635449.255996:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:14431:x1876568410542592:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1110us (1352us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789635449.256004:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:0.0:1789635449.266690:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.266753:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.266913:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410542848 00000100:00100000:3.0:1789635449.266929:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410542848 00000100:00100000:3.0:1789635449.267012:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1789635449.267032:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:2349:x1876568410542848:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635449.267439:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635449.267466:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d548 expref: 15 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.267488:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635449.267493:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635449.267560:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:2349:x1876568410542848:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 539us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635449.267568:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789635449.274079:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410542720 00000100:00100000:2.0:1789635449.274097:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410542720 00000100:00100000:2.0:1789635449.274171:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:2.0:1789635449.274182:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14431:x1876568410542720:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789635449.274271:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274289:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274301:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274357:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274364:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274370:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274377:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:2.0:1789635449.274409:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274419:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274432:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:2.0:1789635449.274435:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789635449.274440:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.274447:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635449.274540:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14431:x1876568410542720:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 359us (7860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635449.274548:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1789635449.279984:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.281231:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410543104 00000100:00100000:3.0:1789635449.281245:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410543104 00000100:00100000:3.0:1789635449.281707:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789635449.281775:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14431:x1876568410543104:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789635449.282035:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:14431:x1876568410543104:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 308us (2051us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789635449.292292:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789635449.720501:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.720608:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410543360 00000100:00100000:0.0:1789635449.720620:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410543360 00000100:00100000:0.0:1789635449.720733:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1789635449.720745:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:14462:x1876568410543360:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:0.0:1789635449.720781:0:16411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635449.720806:0:16411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d54f expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.720908:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c400/0x77332204cfbb42c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.720947:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c400/0x77332204cfbb42c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.720960:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c400/0x77332204cfbb42c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635449.720985:0:16411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789635449.721161:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d54f expref: 18 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.721183:0:16411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c400/0x77332204cfbb42c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d54f expref: 17 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.721193:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:0.0:1789635449.721196:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789635449.721200:0:16411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303c400, rc 0) 00000100:00100000:0.0:1789635449.721273:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+17:14462:x1876568410543360:12345-192.168.201.30@tcp:101:cat.0 Request processed in 530us (961us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789635449.721281:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1789635449.729633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.729684:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.730464:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410543744 00000100:00100000:3.0:1789635449.730478:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410543744 00000100:00100000:3.0:1789635449.730543:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:3.0:1789635449.730559:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+17:14462:x1876568410543744:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:3.0:1789635449.730929:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+18:14462:x1876568410543744:12345-192.168.201.30@tcp:35:cat.0 Request processed in 376us (1243us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789635449.730956:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1789635449.731074:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410543488 00000100:00100000:1.0:1789635449.731080:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410543488 00000100:00100000:1.0:1789635449.731117:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1789635449.731126:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+18:2351:x1876568410543488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635449.731137:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635449.731163:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c400/0x77332204cfbb42c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d54f expref: 18 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.731184:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:1.0:1789635449.731189:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635449.731208:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+17:2351:x1876568410543488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 84us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635449.731215:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789635449.799852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.800097:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410544000 00000100:00100000:0.0:1789635449.800110:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410544000 00000100:00100000:0.0:1789635449.800180:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:0.0:1789635449.800191:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+17:14468:x1876568410544000:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1789635449.800216:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635449.800235:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb42ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d556 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.801406:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.801432:0:14485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 18 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.801442:0:14485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 18 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.801452:0:14485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.801496:0:14485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 18 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.801515:0:14485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 18 pid: 16411 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635449.801533:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876568422058624:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635449.801853:0:14485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 18 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.801864:0:14485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 18 pid: 14484 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635449.801874:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876568422058752:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635449.801926:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492600 going to sleep for 11 seconds 00000100:00100000:0.0:1789635449.805771:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.805802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635449.805945:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410544128 00000100:00100000:1.0:1789635449.805958:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410544128 00010000:00010000:1.0:1789635449.806007:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 19 pid: 16411 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635449.806068:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410544256 00000100:00100000:1.0:1789635449.806072:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410544256 00010000:00010000:1.0:1789635449.806086:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 20 pid: 14484 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635449.806102:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1789635449.806111:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c3a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:2348:x1876568410544128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635449.806126:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635449.806132:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 20 pid: 16411 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806146:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 20 pid: 16411 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806171:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:1.0:1789635449.806177:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806186:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806205:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635449.806264:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c3a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:2348:x1876568410544128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 153us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635449.806273:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1789635449.806357:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1789635449.806366:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+19:2348:x1876568410544256:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789635449.806393:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635449.806398:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218200/0x77332204cfbb4288 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d53a expref: 19 pid: 16411 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806402:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 19 pid: 14484 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806426:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 18 pid: 14484 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635449.806432:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876568422058624:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635449.806441:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:1.0:1789635449.806447:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.806451:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219400/0x77332204cfbb4273 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d533 expref: 18 pid: 14484 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806460:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.806469:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635449.806489:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876568422058752:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789635449.806499:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789635449.806515:0:14485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635449.806524:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+17:2348:x1876568410544256:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 156us (719us total) trans 0 rc 0/0 00010000:00010000:2.0:1789635449.806529:0:14485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635449.806535:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00010000:00010000:2.0:1789635449.806541:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789635449.806562:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789635449.806736:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb42ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d556 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.806754:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303ca00/0x77332204cfbb42d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d556 expref: 17 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.806762:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:2.0:1789635449.806765:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789635449.806767:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303ca00, rc 0) 00000100:00100000:2.0:1789635449.806791:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+17:14468:x1876568410544000:12345-192.168.201.30@tcp:101:dd.0 Request processed in 6603us (6953us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789635449.806799:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:1.0:1789635449.810878:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635449.810976:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410544512 00000100:00100000:3.0:1789635449.810989:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410544512 00000100:00100000:3.0:1789635449.811088:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789635449.811099:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+17:14468:x1876568410544512:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:2.0:1789635449.811523:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.811544:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.811568:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635449.811630:0:14484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789635449.811672:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007482cf02 reply state 00000000af55f698 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635449.811683:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789635449.811788:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14468:x1876568410544512:12345-192.168.201.30@tcp:36:dd.0 Request processed in 689us (919us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789635449.811796:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000020:00080000:2.0:1789635449.811802:0:14484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789635449.814199:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635449.814334:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410544640 00000100:00100000:2.0:1789635449.814430:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410544640 00000100:00100000:2.0:1789635449.814494:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:2.0:1789635449.814506:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14468:x1876568410544640:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1789635449.814532:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635449.814555:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb42ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d55d expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.814613:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb42ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d55d expref: 21 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.814629:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb42ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d55d expref: 21 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635449.814648:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:2.0:1789635449.814651:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635449.814668:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe821200, rc 0) 00000100:00100000:2.0:1789635449.814734:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+21:14468:x1876568410544640:12345-192.168.201.30@tcp:101:dd.0 Request processed in 230us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635449.814741:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00010000:00010000:3.0:1789635449.815543:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.815557:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.815566:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.815574:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820c00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635449.815579:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.815588:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.815613:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635449.815616:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635449.815620:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635449.815627:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820c00/0x77332204cfbb42e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635449.825061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635449.825160:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410544896 00000100:00100000:1.0:1789635449.825173:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410544896 00000100:00100000:1.0:1789635449.825631:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1789635449.825647:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14468:x1876568410544896:12345-192.168.201.30@tcp:103:dd.0 00010000:00010000:1.0:1789635449.825667:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789635449.825711:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe821200/0x77332204cfbb42ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d55d expref: 20 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635449.825736:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:1.0:1789635449.825741:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789635449.825808:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+19:14468:x1876568410544896:12345-192.168.201.30@tcp:103:dd.0 Request processed in 166us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635449.825816:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1789635449.827551:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.827838:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410545024 00000100:00100000:0.0:1789635449.827849:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410545024 00000100:00100000:0.0:1789635449.827902:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:0.0:1789635449.827912:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+19:14468:x1876568410545024:12345-192.168.201.30@tcp:58:dd.0 00010000:00010000:0.0:1789635449.828017:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.828038:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.828049:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789635449.829617:0:16411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789635449.829794:0:16411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789635449.829870:0:16411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789635449.830004:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+19:14468:x1876568410545024:12345-192.168.201.30@tcp:58:dd.0 Request processed in 2088us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635449.830015:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1789635449.834079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635449.834150:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410545152 00000100:00100000:0.0:1789635449.834161:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410545152 00000100:00100000:0.0:1789635449.834475:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1789635449.834488:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+19:14468:x1876568410545152:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1789635449.834512:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635449.834534:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d564 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.834848:0:14485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.834862:0:14485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d564 expref: 20 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.834882:0:14485:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.834896:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d564 expref: 20 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.834909:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:0.0:1789635449.834913:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789635449.834916:0:14485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d564 expref: 20 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635449.834924:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303d800, rc 0) 00000100:00100000:0.0:1789635449.834981:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14468:x1876568410545152:12345-192.168.201.30@tcp:101:dd.0 Request processed in 497us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635449.834988:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00010000:00010000:3.0:1789635449.876079:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635450.644203:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789635450.644226:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422058880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789635450.644298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635450.644929:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422058880 00000100:00100000:3.0:1789635450.644941:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422058880 00000100:00100000:3.0:1789635450.645007:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789635450.645018:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422058880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789635450.645066:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635450.645130:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422058880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635450.645137:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789635450.645233:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422058880:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789635450.771799:0:14516:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789635450.771808:0:14516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789635450.771842:0:14516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789635450.771848:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789635450.771968:0:14516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14516:1876568422059008:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789635450.772072:0:14516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789635450.777457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.777733:0:14516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14516:1876568422059008:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789635450.778880:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410545280 00000100:00100000:1.0:1789635450.778892:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410545280 00000100:00100000:1.0:1789635450.779002:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1789635450.779013:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410545280:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789635450.779102:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410545280:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 Request processed in 90us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635450.779109:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789635450.784523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635450.788342:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410545408 00000100:00100000:2.0:1789635450.788357:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410545408 00000100:00100000:2.0:1789635450.788450:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789635450.788461:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410545408:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789635450.788495:0:14484:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789635450.788814:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410545408:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 353us (4299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635450.788824:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789635450.793039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.793119:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410545536 00000100:00100000:3.0:1789635450.793136:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410545536 00000100:00100000:3.0:1789635450.793200:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1789635450.793291:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410545536:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789635450.793447:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793464:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793477:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793489:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793496:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793503:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793532:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793559:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.793567:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635450.793617:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789635450.793622:0:14486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635450.794021:0:14486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794037:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794046:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794053:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794060:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635450.794064:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794071:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794081:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:3.0:1789635450.794083:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635450.794129:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794144:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb42ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794156:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794160:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794164:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794167:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219a00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635450.794169:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794172:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794177:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e79d3900200) 00010000:00010000:3.0:1789635450.794179:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635450.794181:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794184:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4306 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794196:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794199:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794206:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794209:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219200 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635450.794211:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794214:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794218:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635450.794219:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635450.794221:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.794224:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb430d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635450.794349:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410545536:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1101us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635450.794373:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1789635450.799276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635450.800236:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410545792 00000100:00100000:2.0:1789635450.800254:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410545792 00000100:00100000:0.0:1789635450.800417:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:0.0:1789635450.800445:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410545792:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635450.800489:0:16411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635450.800514:0:16411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4314 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d56b expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800766:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800784:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800796:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789635450.800807:0:16411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789635450.800909:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800916:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800923:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800929:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303d600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635450.800933:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800940:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800953:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:0.0:1789635450.800963:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789635450.800968:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.800974:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb431b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.801021:0:16411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4314 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d56b expref: 22 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.801032:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e79d088e600) 00010000:00010000:0.0:1789635450.801034:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789635450.801038:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c000/0x77332204cfbb4314 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d56b expref: 22 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.801047:0:16411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303c000, rc 0) 00000100:00100000:0.0:1789635450.801189:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+21:14469:x1876568410545792:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 756us (1927us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789635450.801197:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:0.0:1789635450.807857:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635450.808081:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410545920 00000100:00100000:2.0:1789635450.808094:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410545920 00000100:00100000:2.0:1789635450.808165:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789635450.808187:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+21:14469:x1876568410545920:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789635450.808252:0:14485:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789635450.808412:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+21:14469:x1876568410545920:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 228us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635450.808420:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789635450.812422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.812501:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410546176 00000100:00100000:3.0:1789635450.812512:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410546176 00000100:00100000:3.0:1789635450.812560:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789635450.812584:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+21:14469:x1876568410546176:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635450.812606:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635450.812747:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb4329 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d572 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789635450.813514:0:14484:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1789635450.813521:0:14484:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789635450.813560:0:14484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1789635450.815805:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4330 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.815829:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4330 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.815842:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4330 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.815929:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb4329 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d572 expref: 24 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.815949:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4330 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d572 expref: 23 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.815958:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900200) 00010000:00010000:3.0:1789635450.815961:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789635450.815965:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2219a00, rc 0) 00000100:00100000:3.0:1789635450.816031:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+23:14469:x1876568410546176:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3462us (3617us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789635450.816040:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:1.0:1789635450.830291:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.830518:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410546432 00000100:00100000:0.0:1789635450.830535:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410546432 00000100:00100000:0.0:1789635450.830614:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1789635450.830628:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+23:14469:x1876568410546432:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789635450.830718:0:14485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789635450.830753:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219a00/0x77332204cfbb4330 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d572 expref: 23 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.830805:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900200) 00010000:00010000:0.0:1789635450.830832:0:14485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789635450.830864:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.830881:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.830893:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.830909:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.830918:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.830926:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831525:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831536:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831543:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831550:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303d600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635450.831555:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831569:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831581:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e79d3900e00) 00010000:00010000:0.0:1789635450.831584:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635450.831588:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831595:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d600/0x77332204cfbb433e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831606:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831612:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831618:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831624:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303dc00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:0.0:1789635450.831626:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831632:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831698:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc6cd70 (ffff9e79d088ee00) 00010000:00010000:0.0:1789635450.831701:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789635450.831704:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.831721:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303dc00/0x77332204cfbb4345 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc6cd70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635450.832449:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+22:14469:x1876568410546432:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1816us (2165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789635450.832463:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1789635450.836187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.836294:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410546560 00000100:00100000:3.0:1789635450.836350:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410546560 00000100:00100000:3.0:1789635450.836432:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:3.0:1789635450.836444:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+22:14469:x1876568410546560:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635450.836479:0:16411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635450.836505:0:16411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb434c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d579 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.836542:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4353 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.836555:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.836567:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.836691:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb434c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d579 expref: 24 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.836712:0:16411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218e00/0x77332204cfbb4353 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d579 expref: 23 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.836722:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:3.0:1789635450.836725:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635450.836728:0:16411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2218e00, rc 0) 00000100:00100000:3.0:1789635450.836796:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+23:14469:x1876568410546560:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 355us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635450.836803:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1789635450.839866:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.839970:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410546816 00000100:00100000:3.0:1789635450.839986:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410546816 00000100:00100000:3.0:1789635450.840051:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:3.0:1789635450.840062:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+23:14469:x1876568410546816:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789635450.840162:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.840193:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.840205:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789635450.840688:0:14486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1789635450.840699:0:14486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426660387451ns, next at 427660384770ns, rc = 0 00000004:00010000:3.0:1789635450.840788:0:14486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ad14210 reply state 00000000d51ecf75 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635450.840798:0:14486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635450.840906:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+25:14469:x1876568410546816:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 844us (1051us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789635450.840914:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00010000:00010000:3.0:1789635450.843265:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.843283:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.843291:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.843297:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635450.843302:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.843353:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.843383:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:3.0:1789635450.843387:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789635450.843392:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.843399:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb435a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635450.845993:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635450.846128:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410546944 00000100:00100000:2.0:1789635450.846142:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410546944 00000100:00100000:2.0:1789635450.846450:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789635450.846465:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+24:14469:x1876568410546944:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789635450.846502:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789635450.846532:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d580 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.846614:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 25 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.846632:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 25 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.846665:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:2.0:1789635450.846668:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789635450.846673:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79fe820800, rc 0) 00000100:00100000:2.0:1789635450.846745:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+25:14469:x1876568410546944:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 285us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635450.846754:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1789635450.849928:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.850121:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410547072 00000100:00100000:0.0:1789635450.850136:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410547072 00000100:00100000:0.0:1789635450.850238:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789635450.850251:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2349:x1876568410547072:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789635450.850799:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2349:x1876568410547072:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 547us (883us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789635450.850809:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00080000:2.0:1789635450.851189:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789635450.853520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.856767:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410547328 00000100:00100000:3.0:1789635450.856783:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410547328 00000100:00100000:3.0:1789635450.856858:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789635450.856869:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+25:14469:x1876568410547328:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789635450.857127:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+26:14469:x1876568410547328:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 259us (3616us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789635450.857134:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789635450.859915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.860024:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410547584 00000100:00100000:0.0:1789635450.860034:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410547584 00000100:00100000:0.0:1789635450.860095:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1789635450.860106:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+26:14469:x1876568410547584:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789635450.860233:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+26:14469:x1876568410547584:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635450.860241:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:1.0:1789635450.865606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.865829:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410547712 00000100:00100000:3.0:1789635450.865846:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410547712 00000100:00100000:3.0:1789635450.865922:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789635450.865935:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+26:14469:x1876568410547712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789635450.865964:0:16411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789635450.866296:0:16411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4368 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d587 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.866537:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb436f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.866555:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb436f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.866570:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb436f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789635450.866616:0:16411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789635450.866705:0:16411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb436f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.866740:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb4368 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d587 expref: 28 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.866760:0:16411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb436f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d587 expref: 27 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.866768:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:3.0:1789635450.866772:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789635450.866776:0:16411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e78c2219200, rc 0) 00000100:00100000:3.0:1789635450.866919:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+27:14469:x1876568410547712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 986us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635450.866928:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:2.0:1789635450.870266:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.870569:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410547840 00000100:00100000:3.0:1789635450.870584:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410547840 00000100:00100000:0.0:1789635450.870711:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789635450.870738:0:15167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2349:x1876568410547840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635450.870774:0:15167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635450.870799:0:15167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d58e expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789635450.870826:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aabab7c, blocks: 0x1 00010000:00010000:0.0:1789635450.870846:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1789635450.870851:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635450.870860:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.870877:0:15167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 7 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.870891:0:15167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303d600, rc 0) 00000100:00100000:0.0:1789635450.870963:0:15167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2349:x1876568410547840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 238us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635450.870970:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1789635450.878068:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.881609:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410548096 00000100:00100000:0.0:1789635450.881791:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410548096 00000100:00100000:0.0:1789635450.881983:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1789635450.881997:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+27:14469:x1876568410548096:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789635450.882474:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+27:14469:x1876568410548096:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 478us (4494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635450.882486:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1789635450.885472:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635450.885616:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410548224 00000100:00100000:2.0:1789635450.885629:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410548224 00000100:00100000:2.0:1789635450.885702:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:2.0:1789635450.885715:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+27:14469:x1876568410548224:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789635450.899800:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789635450.925335:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:1.0:1789635450.925388:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789635450.925397:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789635450.925555:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422059136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789635450.925619:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14469:x1876568410548224:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 39895us (40146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635450.925633:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1789635450.926241:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635450.926577:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422059136 00000100:00100000:0.0:1789635450.926607:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422059136 00000100:00100000:0.0:1789635450.926733:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789635450.926745:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422059136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789635450.926913:0:15170:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789635450.926918:0:15170:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789635450.926920:0:15170:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789635450.926923:0:15170:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789635452 -> 1789635452 00002000:00010000:0.0:1789635450.926926:0:15170:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789635450.926979:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876568422059136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 236us (740us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789635450.926986:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1789635450.927194:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e79dba5dc00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789635450.927205:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79dba5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422059136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789635450.928935:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.931808:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410548352 00000100:00100000:0.0:1789635450.931827:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410548352 00000100:00100000:0.0:1789635450.931915:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789635450.931930:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2348:x1876568410548352:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789635450.932086:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2348:x1876568410548352:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 160us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635450.932094:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789635450.940458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.940553:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410548608 00000100:00100000:3.0:1789635450.940590:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410548608 00000100:00100000:3.0:1789635450.940786:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789635450.940800:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14469:x1876568410548608:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789635450.940889:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635450.940925:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2219200/0x77332204cfbb436f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d587 expref: 14 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.940950:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:3.0:1789635450.940957:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789635450.941010:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.941027:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.941039:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789635450.941307:0:14486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcbff062 reply state 000000008c78e1fc transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635450.941417:0:14486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789635450.941561:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:14469:x1876568410548608:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 764us (1113us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789635450.941571:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00010000:00010000:3.0:1789635450.944097:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635450.944127:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1789635450.944128:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.944167:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.944175:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635450.944181:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.944191:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.944213:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:3.0:1789635450.944217:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635450.944222:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.944229:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb437d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635450.944533:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410548736 00000100:00100000:0.0:1789635450.944547:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410548736 00000100:00100000:0.0:1789635450.944689:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789635450.944701:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:14469:x1876568410548736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789635450.944721:0:15170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789635450.944746:0:15170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d62b8f5c632d595 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.944776:0:15170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.944800:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635450.944805:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635450.944812:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 8 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.944850:0:15170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 8 pid: 15167 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.944864:0:15170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 8 pid: 15167 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635450.944879:0:15170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15170:1876568422059264:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635450.944963:0:15170:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fdb45180 going to sleep for 11 seconds 00000100:00100000:1.0:1789635450.947386:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.947888:0:15170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15170:1876568422059264:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635450.947924:0:15170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 8 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.947946:0:15170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e79f303dc00, rc 0) 00000100:00100000:0.0:1789635450.947995:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+8:14469:x1876568410548736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3296us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635450.948004:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789635450.949059:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410548864 00000100:00100000:2.0:1789635450.949070:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410548864 00010000:00010000:2.0:1789635450.949110:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 8 pid: 15167 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635450.949196:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1789635450.949206:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79dba5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+8:2348:x1876568410548864:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635450.949230:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635450.949253:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 8 pid: 15167 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.949266:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 8 pid: 15167 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.949289:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fcfd777/0x77332204cfbb4376 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d58e expref: 8 pid: 15167 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.949330:0:14470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635450.949335:0:14470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635450.949342:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 7 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.949354:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 7 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.949406:0:14470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 7 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635450.949422:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14470:1876568422059392:192.168.201.30@tcp:105: 00000100:00100000:2.0:1789635450.949537:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79db96e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789635450.955214:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14470:1876568422059392:192.168.201.30@tcp:105: 00010000:00010000:2.0:1789635450.955244:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789635450.955326:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79dba5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2348:x1876568410548864:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6104us (7930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635450.955338:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1789635450.956055:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.956346:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410548992 00000100:00100000:0.0:1789635450.956355:0:15167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410548992 00000100:00100000:0.0:1789635450.956423:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789635450.956433:0:15167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2349:x1876568410548992:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789635450.956662:0:15167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789635450.956666:0:15167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789635451 00002000:00010000:0.0:1789635450.956668:0:15167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789635450 00002000:00010000:0.0:1789635450.956670:0:15167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789635452 -> 1789635451 00002000:00010000:0.0:1789635450.956672:0:15167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789635450.956726:0:15167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+8:2349:x1876568410548992:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 294us (674us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789635450.956734:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1789635450.962639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.962792:0:15593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410549120 00000100:00100000:0.0:1789635450.962803:0:15593:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410549120 00000100:00100000:0.0:1789635450.962867:0:15593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789635450.962877:0:15593:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+8:2350:x1876568410549120:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789635450.962925:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.962946:0:15593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 8 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.962955:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635450.962960:0:15593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789635450.962965:0:15593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.963003:0:15593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 8 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.963030:0:15593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 8 pid: 15170 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635450.963046:0:15593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15593:1876568422059520:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789635450.963129:0:15593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79fdb45180 going to sleep for 11 seconds 00000100:00100000:0.0:1789635450.968163:0:15593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fe92d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15593:1876568422059520:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789635450.968207:0:15593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635450.968705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635450.968999:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410549248 00000100:00100000:3.0:1789635450.969009:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410549248 00010000:00010000:3.0:1789635450.969049:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 9 pid: 15170 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635450.969093:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1789635450.969103:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:2349:x1876568410549248:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789635450.969118:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789635450.969141:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 9 pid: 15170 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.969186:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 9 pid: 15170 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.969212:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe8900b0/0x77332204cfbb4384 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d595 expref: 9 pid: 15170 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.969240:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635450.969245:0:14471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789635450.969250:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.969261:0:14471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635450.969293:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789635450.969407:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+8:2349:x1876568410549248:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 304us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635450.969415:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00010000:00010000:1.0:1789635450.969738:0:15593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969749:0:15593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969777:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969785:0:15593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969795:0:15593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969803:0:15593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303c000 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635450.969815:0:15593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969825:0:15593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969838:0:15593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.969846:0:15593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005725834c/0x77332204cfbb438b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635450.969902:0:15593:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2350:x1876568410549120:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 7026us (7273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635450.969911:0:15593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1789635450.974000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.974098:0:16411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410549504 00000100:00100000:0.0:1789635450.974109:0:16411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410549504 00000100:00100000:0.0:1789635450.974177:0:16411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1789635450.974188:0:16411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:14469:x1876568410549504:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789635450.974288:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.974306:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635450.974526:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.974866:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.974880:0:16411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 15 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.974887:0:16411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.974922:0:16411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 15 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.974937:0:16411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 15 pid: 14484 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635450.974959:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16411:1876568422059648:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789635450.975056:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79c3f26d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789635450.978869:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16411:1876568422059648:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789635450.978898:0:16411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635450.987670:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635450.988367:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410549632 00000100:00100000:2.0:1789635450.988378:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410549632 00010000:00010000:2.0:1789635450.988419:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 16 pid: 14484 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635450.988459:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:2.0:1789635450.988483:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+16:2349:x1876568410549632:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789635450.988499:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789635450.988505:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 16 pid: 14484 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.988519:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 16 pid: 14484 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.988542:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79fe820800/0x77332204cfbb4361 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d580 expref: 16 pid: 14484 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.988558:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:2.0:1789635450.988563:0:14470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.988572:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.988580:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635450.988621:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789635450.988749:0:16411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.988759:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635450.988931:0:16411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789635450.989052:0:16411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789635450.989093:0:16411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789635450.989178:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16411:1876568422059776:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789635450.989237:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635450.989266:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79d0492600 going to sleep for 11 seconds 00000100:00100000:1.0:1789635450.989489:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422059776 00000100:00100000:1.0:1789635450.989494:0:14489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422059776 00000100:00100000:1.0:1789635450.989527:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789635450.989535:0:14489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16411:x1876568422059776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789635450.989678:0:14489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16411:x1876568422059776:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635450.989686:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789635450.989710:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+18:2349:x1876568410549632:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1225us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635450.989721:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1789635450.989751:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16411:1876568422059776:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789635450.990854:0:16411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789635450.990937:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16411:1876568422059904:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789635450.990987:0:16411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789635450.991080:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e6b64300 going to sleep for 11 seconds 00000100:00100000:2.0:1789635450.991134:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422059904 00000100:00100000:2.0:1789635450.991140:0:14489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422059904 00000100:00100000:2.0:1789635450.991174:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789635450.991184:0:14489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16411:x1876568422059904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789635450.991571:0:14489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16411:x1876568422059904:12345-0@lo:1000:mdt00_003.0 Request processed in 388us (583us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789635450.991580:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789635450.991711:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16411:1876568422059904:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789635450.991745:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991755:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991762:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991769:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85e00 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635450.991773:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991781:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991797:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:1.0:1789635450.991800:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635450.991805:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991811:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79d3b85e00/0x77332204cfbb4399 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991843:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991850:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991855:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991869:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303d000 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:1.0:1789635450.991872:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991878:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991887:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:1.0:1789635450.991889:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789635450.991896:0:16411:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d564 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991907:0:16411:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d564 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991916:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d564 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635450.991969:0:16411:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d800/0x77332204cfbb42f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x1d62b8f5c632d564 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635450.991981:0:16411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79c7b5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16411:1876568422060032:192.168.201.30@tcp:105: 00000100:00100000:1.0:1789635450.992037:0:16411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e79e6b64300 going to sleep for 11 seconds 00000100:00100000:1.0:1789635450.999914:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635450.999994:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410549760 00000100:00100000:0.0:1789635451.000005:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410549760 00000100:00100000:0.0:1789635451.000064:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789635451.000075:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c2bdb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+19:14468:x1876568410549760:12345-192.168.201.30@tcp:49:dd.0 00000100:00100000:0.0:1789635451.000234:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c2bdb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+19:14468:x1876568410549760:12345-192.168.201.30@tcp:49:dd.0 Request processed in 161us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635451.000242:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1789635451.002762:0:16411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79c7b5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16411:1876568422060032:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789635451.002811:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002822:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303d000/0x77332204cfbb42f1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002859:0:16411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002874:0:16411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002886:0:16411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002897:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002903:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002910:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002916:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218400 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635451.002919:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002927:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002940:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635451.002950:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789635451.002955:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002960:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e78c2218400/0x77332204cfbb43a0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002971:0:16411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002976:0:16411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002981:0:16411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002986:0:16411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303c600 already unused, calling callback (ffffffffc201e4f0) 00010000:00010000:3.0:1789635451.002988:0:16411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.002994:0:16411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.003001:0:16411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e79d3900400) 00010000:00010000:3.0:1789635451.003003:0:16411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789635451.003005:0:16411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.003011:0:16411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303c600/0x77332204cfbb4392 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635451.003392:0:16411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+18:14469:x1876568410549504:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 29204us (29400us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789635451.003411:0:16411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000020:00080000:3.0:1789635451.003417:0:16411:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789635451.010540:0:14516:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789635451.010550:0:14516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789635451.010589:0:14516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789635451.010596:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789635451.025965:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635451.026099:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550016 00000100:00100000:0.0:1789635451.026110:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550016 00000100:00080000:2.0:1789635451.026235:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789635451.026639:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789635451.026653:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+18:14469:x1876568410550016:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789635451.027458:0:14488:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789635451.027567:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789635451.027610:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.027627:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.027639:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.027648:0:14488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.027655:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.027661:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.027694:0:14488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789635451.027780:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:14469:x1876568410550016:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1130us (1824us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789635451.027789:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000020:00080000:0.0:1789635451.027794:0:14488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789635451.028491:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789635451.028500:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.028507:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303cc00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635451.028512:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.028520:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.028535:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e79d3900600) 00010000:00010000:3.0:1789635451.028537:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789635451.028541:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.028547:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e79f303cc00/0x77332204cfbb43a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.028560:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635451.028562:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789635451.028563:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789635451.145963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789635451.146017:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635451.146144:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550144 00000100:00100000:0.0:1789635451.146156:0:15173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550144 00000100:00100000:0.0:1789635451.146235:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550272 00000100:00100000:0.0:1789635451.146239:0:15173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550272 00000100:00100000:0.0:1789635451.146264:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789635451.146277:0:15173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+8:2349:x1876568410550144:12345-192.168.201.30@tcp:4:dd.0 00002000:00010000:0.0:1789635451.146382:0:15173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aabab7b, atime: 0x6aabab7a, ctime: 0x6aabab7b, blocks: 0x1 00010000:00010000:0.0:1789635451.146392:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.146409:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1789635451.146414:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789635451.146421:0:15173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.146436:0:15173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635451.153986:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635451.154096:0:15175:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789635451.154107:0:15175:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789635451.160855:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550400 00000100:00100000:3.0:1789635451.160872:0:15175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550400 00000100:00100000:2.0:1789635451.164022:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789635451.164047:0:16713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+10:2349:x1876568410550272:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:2.0:1789635451.164093:0:16713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.164112:0:16713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.164117:0:16713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.164124:0:16713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.164139:0:16713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635451.261581:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1789635451.261603:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1789635451.261613:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1789635451.261965:0:15173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1789635451.261970:0:15173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789635451 -> 1789635452 00002000:00010000:3.0:1789635451.261973:0:15173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789635451.261988:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262013:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262037:0:15173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262045:0:15173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79f303c400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:3.0:1789635451.262051:0:15173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262064:0:15173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262085:0:15173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262095:0:15173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d377f7/0x77332204cfbb43ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789635451.262182:0:15173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+10:2349:x1876568410550144:12345-192.168.201.30@tcp:4:dd.0 Request processed in 115903us (116224us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789635451.262198:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1789635451.262226:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1789635451.262238:0:15173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79c7b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:2348:x1876568410550400:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:3.0:1789635451.262270:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262287:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789635451.262292:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635451.262299:0:15173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.262365:0:15173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789635451.293461:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1789635451.293541:0:16713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1789635451.293546:0:16713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789635451.294076:0:16713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.294092:0:16713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.294102:0:16713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.294110:0:16713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635451.294116:0:16713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.294126:0:16713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.294150:0:16713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.294158:0:16713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fb28790/0x77332204cfbb43b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635451.294297:0:16713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:2349:x1876568410550272:12345-192.168.201.30@tcp:4:dd.0 Request processed in 130254us (148275us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789635451.294367:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000001:00080000:1.0:1789635451.379967:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1789635451.380052:0:15173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789635451.380069:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.380101:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.380111:0:15173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.380119:0:15173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2218400 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635451.380124:0:15173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.380134:0:15173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.380155:0:15173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.380241:0:15173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd689cfb/0x77332204cfbb43bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635451.380465:0:15173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79c7b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2348:x1876568410550400:12345-192.168.201.30@tcp:4:dd.0 Request processed in 118226us (226487us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789635451.380477:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1789635451.389688:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635451.389731:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635451.389883:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550528 00000100:00100000:3.0:1789635451.389895:0:15175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550528 00000100:00100000:3.0:1789635451.389977:0:15175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550656 00000100:00100000:3.0:1789635451.389981:0:15175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550656 00000100:00100000:3.0:1789635451.390018:0:15175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1789635451.390029:0:15175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+6:2349:x1876568410550528:12345-192.168.201.30@tcp:4:dd.0 00002000:00010000:3.0:1789635451.390077:0:15175:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aabab7c, atime: 0x6aabab7a, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1789635451.390086:0:15175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.390104:0:15175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789635451.390109:0:15175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789635451.390115:0:15175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789635451.390131:0:15175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635451.390427:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789635451.390437:0:15173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2348:x1876568410550656:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:2.0:1789635451.390456:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.390475:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.390478:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.390482:0:15173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.390492:0:15173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635451.394070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635451.394106:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789635451.394131:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789635451.394531:0:15174:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789635451.394544:0:15174:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1789635451.395075:0:16713:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789635451.395086:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550912 00000100:00100000:3.0:1789635451.395095:0:16713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550912 00000100:00100000:3.0:1789635451.395143:0:16713:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789635451.395147:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410550784 00000100:00100000:3.0:1789635451.395149:0:16713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410550784 00000100:00100000:3.0:1789635451.395169:0:16713:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789635451.395173:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551040 00000100:00100000:3.0:1789635451.395175:0:16713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551040 00000100:00100000:1.0:1789635451.401413:0:16715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789635451.401433:0:16715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3c242a26-81b5-4d10-8aab-35c76a4f1728+11:2349:x1876568410550912:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:1.0:1789635451.401497:0:16715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.401517:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635451.401522:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789635451.401529:0:16715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.401544:0:16715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635451.542144:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1789635451.542234:0:15175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:2.0:1789635451.542239:0:15175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789635452 00002000:00010000:2.0:1789635451.542241:0:15175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1789635451.542256:0:15175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.542269:0:15175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.542280:0:15175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.542287:0:15175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e78c2219200 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635451.542292:0:15175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.542340:0:15175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.542372:0:15175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.542380:0:15175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000976451de/0x77332204cfbb43c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635451.542874:0:15175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:2349:x1876568410550528:12345-192.168.201.30@tcp:4:dd.0 Request processed in 152433us (152783us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789635451.542885:0:15175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1789635451.542917:0:15175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789635451.542930:0:15175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+14:2349:x1876568410550784:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:2.0:1789635451.542962:0:15175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.542976:0:15175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.542981:0:15175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.542988:0:15175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.543001:0:15175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789635451.605234:0:16715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1789635451.605256:0:16715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.605270:0:16715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.605280:0:16715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.605287:0:16715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79d3b85600 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635451.605292:0:16715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.605301:0:16715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.605343:0:16715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.605362:0:16715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcad64d6/0x77332204cfbb43d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635451.605450:0:16715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3c242a26-81b5-4d10-8aab-35c76a4f1728+16:2349:x1876568410550912:12345-192.168.201.30@tcp:4:dd.0 Request processed in 204019us (211384us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789635451.606738:0:16715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789635451.606783:0:16715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789635451.606798:0:16715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3c242a26-81b5-4d10-8aab-35c76a4f1728+15:2348:x1876568410551040:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:2.0:1789635451.606838:0:16715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.606855:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.606860:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789635451.606867:0:16715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.606881:0:16715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789635451.607203:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:1.0:1789635451.607502:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.607513:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.607522:0:15173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.607539:0:15173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820800 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:1.0:1789635451.607545:0:15173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.607554:0:15173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.607570:0:15173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789635451.607579:0:15173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074681b4/0x77332204cfbb43ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789635451.607634:0:15173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c242a26-81b5-4d10-8aab-35c76a4f1728+11:2348:x1876568410550656:12345-192.168.201.30@tcp:4:dd.0 Request processed in 217197us (217900us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789635451.607642:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000001:00080000:2.0:1789635451.677597:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1789635451.677657:0:15175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1789635451.677661:0:15175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1789635451.677677:0:15175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.677690:0:15175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.677699:0:15175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.677723:0:15175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe821e00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:2.0:1789635451.677729:0:15175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.677739:0:15175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.677761:0:15175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789635451.677769:0:15175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6342ea5/0x77332204cfbb43d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789635451.677867:0:15175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c242a26-81b5-4d10-8aab-35c76a4f1728+9:2349:x1876568410550784:12345-192.168.201.30@tcp:4:dd.0 Request processed in 134937us (283755us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789635451.677878:0:15175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00002000:00010000:0.0:1789635451.742653:0:16715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789635451.742677:0:16715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.742704:0:16715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.742714:0:16715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.742722:0:16715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e79fe820a00 already unused, calling callback (ffffffffc15b3f90) 00010000:00010000:0.0:1789635451.742728:0:16715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.742738:0:16715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.742761:0:16715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789635451.742769:0:16715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd8f1be4/0x77332204cfbb43df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789635451.742882:0:16715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fd5d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3c242a26-81b5-4d10-8aab-35c76a4f1728+7:2348:x1876568410551040:12345-192.168.201.30@tcp:4:dd.0 Request processed in 136086us (348745us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789635451.742892:0:16715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000001:00080000:3.0:1789635451.743525:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1789635451.923637:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635452.527704:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635452.527755:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635452.527787:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635452.527808:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635452.527825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635452.527841:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635452.527860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789635452.527888:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551680 00000100:00100000:3.0:1789635452.527899:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551680 00000100:00100000:3.0:1789635452.527955:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551296 00000100:00100000:3.0:1789635452.527958:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551296 00000100:00100000:3.0:1789635452.527982:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1789635452.527992:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2350:x1876568410551680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635452.528073:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+6:2350:x1876568410551680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635452.528081:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1789635452.528098:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1789635452.528104:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:2350:x1876568410551296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789635452.528165:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+20:2350:x1876568410551296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 60us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635452.528172:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:0.0:1789635452.528354:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551168 00000100:00100000:0.0:1789635452.528360:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551168 00000100:00100000:0.0:1789635452.528390:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:0.0:1789635452.528397:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2350:x1876568410551168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789635452.528433:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9cc2b2b-9937-4a26-8ec8-02b005c41d88+13:2350:x1876568410551168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635452.528440:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:1.0:1789635452.528547:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551424 00000100:00100000:1.0:1789635452.528552:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551424 00000100:00100000:1.0:1789635452.528579:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551936 00000100:00100000:1.0:1789635452.528582:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551936 00000100:00100000:1.0:1789635452.528596:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551552 00000100:00100000:1.0:1789635452.528598:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551552 00000100:00100000:1.0:1789635452.528610:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568410551808 00000100:00100000:1.0:1789635452.528613:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568410551808 00000100:00100000:1.0:1789635452.528629:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789635452.528636:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410551424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635452.528673:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410551424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635452.528680:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789635452.528695:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1789635452.528702:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410551936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635452.528726:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410551936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635452.528732:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1789635452.528743:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789635452.528748:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410551552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635452.528770:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c242a26-81b5-4d10-8aab-35c76a4f1728+5:2350:x1876568410551552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635452.528776:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789635452.528785:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1789635452.528791:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410551808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789635452.528813:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2c469f2-76dd-45bb-aea0-67c58be0b630+5:2350:x1876568410551808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789635452.528819:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00080000:2.0:1789635452.528999:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789635452.529004:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789635452.529006:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789635452.953658:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789635453.360087:0:16753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789635453.972205:0:14473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789635454.227706:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789635454.227731:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79e7b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422060160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789635454.227801:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789635454.227883:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422060160 00000100:00100000:3.0:1789635454.227891:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422060160 00000100:00100000:3.0:1789635454.227967:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789635454.227980:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422060160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789635454.228016:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789635454.228063:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876568422060160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635454.228070:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789635454.228089:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789635454.228379:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79e7b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876568422060160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789635454.228655:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422060672:0@lo:400:kworker.0 00000100:00100000:2.0:1789635454.228694:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789635454.228715:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789635454.228720:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422060544:0@lo:400:kworker.0 00000100:00100000:2.0:1789635454.228755:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635454.228875:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422060288:0@lo:400:kworker.0 00000100:00100000:0.0:1789635454.228908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635454.228949:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422060800:0@lo:400:kworker.0 00000100:00100000:0.0:1789635454.228971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635454.228987:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789635454.228992:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422060416:0@lo:400:kworker.0 00000100:00100000:0.0:1789635454.229014:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789635454.229043:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422060416 00000100:00100000:0.0:1789635454.229049:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422060416 00000100:00100000:0.0:1789635454.229087:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635454.229095:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422060416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789635454.229151:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876568422060416:12345-0@lo:400:kworker.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789635454.229158:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789635454.229185:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789635454.229190:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e79dba5dc00, transno 8589934595 00000004:00080000:0.0:1789635454.229200:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789635454.229215:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876568422060416:0@lo:400:kworker.0 00000100:00100000:2.0:1789635454.230462:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422060288 00000100:00100000:2.0:1789635454.230474:0:14478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422060288 00000100:00100000:2.0:1789635454.230523:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789635454.230531:0:14478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e4a5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3306:x1876568422060288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789635454.230604:0:14478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e4a5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8229a1b-c2b6-4ba8-903c-807c449e978b+19:3306:x1876568422060288:12345-0@lo:400:kworker.0 Request processed in 74us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789635454.230611:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789635454.230753:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422060672 00000100:00100000:3.0:1789635454.230758:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422060672 00000100:00100000:3.0:1789635454.230795:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422060544 00000100:00100000:3.0:1789635454.230799:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422060544 00000100:00100000:3.0:1789635454.230813:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876568422060800 00000100:00100000:3.0:1789635454.230815:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876568422060800 00000100:00100000:3.0:1789635454.230829:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635454.230836:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422060672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635454.230878:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876568422060672:12345-0@lo:400:kworker.0 Request processed in 43us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635454.230884:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789635454.230909:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789635454.230926:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79e7d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422060544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635454.230956:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79e7d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876568422060544:12345-0@lo:400:kworker.0 Request processed in 31us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635454.230962:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789635454.230975:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789635454.230980:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e79fe92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422060800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789635454.231005:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e79fe92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876568422060800:12345-0@lo:400:kworker.0 Request processed in 26us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789635454.231011:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789635454.231037:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789635454.231042:0:14480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789635454.231044:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e79fd5d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8229a1b-c2b6-4ba8-903c-807c449e978b:3306:1876568422060288:0@lo:400:kworker.0 00000100:00100000:3.0:1789635454.231545:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876568422060544:0@lo:400:kworker.0 00000100:00100000:1.0:1789635454.248864:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876568422060800:0@lo:400:kworker.0 00000100:00100000:3.0:1789635454.253092:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e78c1383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876568422060672:0@lo:400:kworker.0 00010000:00010000:2.0:1789635454.997390:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28912 lines, 28912 kept, 0 dropped, 0 bad.